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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 5 

[0001 ] The present invention relates to a method and 
an apparatus tor extracting a moving object in the image 
sequence by using a subtraction between an input im- 
age and a background image, which can stably extract w 
the moving object region even under an environment 
which incorporates illumination changes. 

Description of the Background Art 

15 

[0002] Conventionally known methods for extracting 
a moving object based on image processing include: (1 ) 
a method for storing a reference background image, ex- 
tracting difference data by a subtraction between the in- 
put image and the background image, and obtaining the 20 
moving object by means of the binarization of the differ- 
ence data using a threshold; (2) a method for obtaining 
data on difference between frames by a subtraction be- 
tween the input image and an immediately previous 
frame image as a reference image, and obtaining the 
moving object by means of the binarization of the ob- 
tained data; (3) a method for obtaining correspondences 
between changing points in the reference image and the 
input image by calculating quantities such as motion 
vectors, and obtaining the moving object as a set of 
moved points; (4) a method for obtaining a change be- 
tween the reference image and the input image accord- 
ing to a correlation within a target region, and obtaining 
the moving object as a changed region; and (5) a meth- 
od for carrying out a (shape) recognition and a tracking 
of a moving target. 

[0003] Among these conventionally known methods, 
the methods based on subtraction have an advantage 
that the moving object can be extracted at high speed 
by means of a relatively simple processing, and widely 
used in various fields such as the industrial product in- 
spection and measurement, the automobile measure- 
ment, and the monitoring system. 
[0004] Fig. 1 shows an outline of such a conventional 
method for extracting the moving object based on back- 
ground subtraction, where the moving object is extract- 
ed by obtaining a difference between a reference image 
Y representing a fixed background image and a latest 
input image Xi, and judging a region at which the ob- 
tained difference is greater than or equal to a prescribed 
threshold as the moving object in motion. In this method, 
the moving object can be extracted easily under a cir- 
cumstance in which the background image does not 
change, but when there is an illumination change, the 
reference background image also changes accordingly 
such that the difference obtained in the above procedure 
can be significantly large for the background portion as 
well and it becomes impossible to extract the moving 



object stably. 

[0005] For this reason, it is indispensable for the mov- 
ing object extraction based on background subtraction 
to incorporate the appropriate updating of the back- 
ground image in correspondence to the change of the 
background values. Namely, it is necessary to sequen- 
tially carry out the moving object extraction with respect 
to the input image Xi along with the judgement of the 
change in the background values and the updating of 
the background image to an appropriate new back- 
ground image Yl+1 for the moving object extraction for 
the next input image Xi+1 whenever the background has 
changed. 

[0006] Fig. 2 shows a flow chart for the operation in 
such a moving object extraction based on background 
subtraction incorporating the background updating. 
First, a target image input processing 811 enters the 
frame images sequentially. Then, a background change 
judgement processing 81 2 checks whether there is a 
change in the background values for the input image Xi, 
and whenever there is a change, a background image 
correction processing 813 updates the background im- 
age accordingly. Then, a background subtraction 
processing 814 obtains the difference data between the 
input image Xi and the updated background image, and 
a binarization processing 815 binarizes the obtained dif- 
ference data by using a prescribed threshold, so as to 
output a moving object output 81 6 representing a region 
in the input image Xi specified by the result of the bina- 
rization processing 815 as the moving object. 
[0007] In the above procedure, the conventionally 
used schemes for updating the background image at the 
background image correction processing 813 include a 
scheme for using a weighted sum of the input image val- 
ues and the stored background image values, and a 
scheme for using a straightforward mean of the frame 
image values for immediately previous several frames. 
However, in these schemes, the change in the back- 
ground values is judged without distinguishing a change 
due to a passing of the moving object and a change due 
to the illumination change, so that there has been a 
problem that the background image can be updated er- 
roneously when many moving objects pass through the 
input image. 

[0008] There is also a scheme for extracting the mov- 
ing object by analyzing image features such as shapes 
of objects resulting from the background subtraction, but 
for the input image containing a moving object with a 
changing shape, it is impossible for this scheme to judge 
whether the object extraction result reflects the actual 
moving object or the change in the background values, 
so that it has been extremely difficult to stably extract 
the moving object with a changing shape such as a hu- 
man being. 

[0009] From the article by Kaneta et al: "Image 
Processing Method for Intruder Detection around Power 
Line Towers*, published in IEICE Transactions on infor- 
mation and systems, vol. E76-D, no 1 0, October 1 993, 
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pages 1153-1162, a scheme is known where moving ob- 
jects are detected based on background subtraction and 
the use of histograms of the brightness difference be- 
tween images. When no change is detected, the refer- 
ence image is replaced by an average of the preceding 
reference image and the newest observed image. When 
a significant change is detected, the reference image is 
replaced by an average of the reference image and the 
observed image excluding the detected portion. The de- 
tection of changes in the scene is based on differences 
in brightness between the reference image and the ob- 
served image. The recognition of moving objects (i.e. 
human intruders) is based on a series of restraints (area, 
center of gravity etc) on the potential objects. 
[0010] Thus, a technique for properly updating the 
background image has not been known conventionally, 
and the moving object extraction based on background 
subtraction has not been realized under an environment 
which incorporates large illumination changes such as 
an outdoor site. 

SUMMARY OF THE INVENTION 

[001 1] It is therefore an object of the present invention 
to provide a method and an apparatus for moving object 
extraction based on background subtraction capable of 
stably extracting the moving object such as a human be- 
ing or an automobile, equally under an environment 
which incorporates large illumination changes such as 
an outdoor site as well as under an environment which 
incorporates a gradual background change. 
[0012] According to one aspect of the present inven- 
tion there is provided a method of moving object extrac- 
tion based on background subtraction, comprising the 
steps of: (a) sequentially entering input images contain- 
ing a moving object region to be extracted; (b) storing 
temporal changes of image feature parameter values for 
sub-regions subdividing a frame of each input image en- 
tered at the step (a); (c) statistically processing a tem- 
poral change of the image feature parameter values for 
each sub-region within a prescribed target region of the 
frame stored at the step (b) over a prescribed period of 
time tg to obtain at least one statistical quantity charac- 
terizing said temporal change, judging whether said 
temporal change is due to an illumination change or not 
according to said statistical quantity and a prescribed 
illumination change judging condition, and updating a 
background image value for said each sub-region by a 
new background image value according to the image 
feature parameter values for said each sub-region dur- 
ing the prescribed period of time t^ so as to obtain a 
reconstructed background image; (d) applying a sub- 
traction processing to one of the input images entered 
at the step (a) and the reconstructed background image 
obtained at the step (c) to obtain a subtraction image; 
and (e) applying a binarization processing to the sub- 
traction image obtained at the step (d) to extract the 
moving object region from the input images entered at 



the step (a). 

[001 3] According to another aspect of the present in- 
vention there is provided an apparatus for moving object 
extraction based on background subtraction, compris- 

s ing: input means for sequentially entering input images 
containing a moving object region to be extracted; stor- 
age means for storing temporal changes of image fea- 
ture parameter values for sub-regions subdividing a 
frame of each input image entered by the input means; 

10 background update means for statistically processing a 
temporal change of the image feature parameter values 
for each sub-region within a prescribed target region of 
the frame stored by the storage means over a pre- 
scribed period of time t^ to obtain at least one statistical 
quantity characterizing said temporal change, judging 
whether said temporal change is due to an illumination 
change or not according to said statistical quantity and 
a prescribed illumination change judging condition, and 
updating a background image value for said each sub- 

20 region by a new background image value according to 
the image feature parameter values for said each sub- 
region during the prescribed period of time t c , so as to 
obtain a reconstructed background image; subtraction 
means for applying a subtraction processing to one of 

25 the input images entered by the input means and the 
reconstructed background image obtained by the back- 
ground update means to obtain a subtraction image; 
and binarization means for applying a binarization 
processing to the subtraction image obtained by the 

30 subtraction means to extract the moving object region 
from the input images entered by the input means. 
[001 4] Other features and advantages of the present 
invention will become apparent from the following de- 
scription taken in conjunction with the accompanying 

55 drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 5] Fig. 1 is a schematic diagram indicating an out- 
40 |jne of a conventional method of moving object extrac- 
tion based on background subtraction. 
[001 6] Fig. 2 is a flow chart for the operation in a con- 
ventional method of moving object extraction based on 
background subtraction. 
45 [0017] Fig. 3 is a block diagram showing a system 
configuration of a moving object extraction system in the 
first embodiment of the present invention. 
[0018] Fig. 4 is a block diagram showing a detailed 
functional configuration of the moving object extraction 
so system of Fig. 3. 

[0019] Fig. 5A is an illustration of an exemplary input 
image with a slit used in a moving object extraction sys- 
tem in the second embodiment of the present invention. 
[0020] Fig. 5B is an illustration of an exemplary space- 
rs time image obtained from the input image of Fig. 5A. 
[0021] Fig. 5C is an illustration of an exemplary graph 
indicating temporal change of input value and back- 
ground value obtained from the space-time image of 



3 



5 



EP 0 671 706 B1 



6 



Fig. 5B. 

[0022] Fig. 5D is an illustration of an exemplary 
space-time image indicating the extraction result ob- 
tained from the space-time image of Fig. 5B. 
[0023] Fig. 6 is a block diagram showing a system 
configuration of a moving object extraction system in the 
fourth embodiment of the present invention. 
[0024] Fig. 7 is a block diagram showing a detailed 
functional configuration of a background image region 
reconstruction means in the moving object extraction 
system of Fig. 6. 

[0025] Fig. 8 is a block diagram showing a detailed 
functional configuration of a background image region 
reconstruction means in a moving object extraction sys- 
tem in the fifth embodiment of the present invention. 
[0026] Figs. 9A and 9B are graphs three-dimensional 
feature vector space for explaining the operation in a 
moving object extraction system in the fifth embodiment 
of the present invention. 

[0027] Fig. 1 0 is a block diagram showing a schematic 
configuration of a background image sub-region update 
means in a moving object extraction system in the sixth 
embodiment of the present invention. 
[0028] Fig. 11 is a block diagram showing a detailed 
functional configuration of the background image sub- 
region update means of Fig. 10. 
[0029] Fig. 1 2 is a block diagram showing a system 
configuration of a moving object extraction system in the 
seventh embodiment of the present invention. 
[0030] Figs. 1 3A and 1 3B are diagrams of input image 
sequences for explaining a difference between the first 
and seventh embodiments of the present invention. 
[0031] Figs. 14A and 14B are graphs of temporal 
change of intyensity value for explaining a difference be- 
tween the first and seventh embodiments of the present 
invention. 

[0032] Fig. 15 is a block diagram showing a system 
configuration of a moving object extraction system in the 
eighth embodiment of the present invention. 
[0033] Figs. 16A, 16B, and 16C are graphs showing 
exemplary threshold settings used in the moving object 
extraction system of Fig. 15. 

[0034] Fig. 17 is a block diagram of an exemplary 
physical configuration for an apparatus corresponding 
to the first embodiment of the present invention. 
[0035] Fig. 18 is a block diagram of an exemplary 
physical configuration for an apparatus corresponding 
to the second embodiment of the present invention. 
[0036] Fig. 19 is a block diagram of an exemplary 
physical configuration for an apparatus corresponding 
to the seventh embodiment of the present invention. 
[0037] Fig. 20 is a block diagram of an exemplary 
physical configuration for an apparatus corresponding 
to the eighth embodiment of the present invention. 
[0038] Fig. 21 is a block diagram of a modified phys- 
ical configuration for an apparatus corresponding to the 
first embodiment of the present invention. 
[0039] Fig. 22 is a block diagram of a further modified 



physical configuration for an apparatus corresponding 
to the first embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
5 EMBODIMENTS 

[0040] Referring now to Figs. 3 and 4, the first embod- 
iment of the moving object extraction based on back- 
ground subtraction according to the present invention 

10 will be described in detail. 

[0041 ] Fig. 3 shows system configuration of a moving 
object extraction system in this first embodiment, while 
Fig. 4 shows a detailed functional configuration of the 
moving object extraction system of Fig. 3. 

75 [0042] In Figs. 3 and 4, the system generally compris- 
es: a camera 001 for entering an image sequence of the 
input images; an image feature parameter value tempo- 
ral change storage means 100 including a plurality of 
frame image memories 101, 102, etc. for storing image 

20 feature parameter values for the sequentially entered in- 
put images; a background image region reconstruction 
means 300 for reconstructing the background image ac- 
cording to the temporal change of the stored image fea- 
ture parameter values; and a moving object extraction 

2S means 500 for obtaining a moving object output 520 rep- 
resenting the moving object from the entered input im- 
age and the reconstructed background image. 
[0043] In further detail, each frame image memory in 
the image feature parameter value temporal change 

30 storage means 1 00 stores the image feature parameter 
values for each input image containing a background 
region 110 and a moving object region 120 which is di- 
vided into a plurality of sub-regions a k such as pixels 
located at coordinate positions (x, y) within each frame. 

35 in this first embodiment, an intensity at each pixel is 
used as an exemplary image feature parameter at each 
sub-region a^ 

[0044] The background image region reconstruction 
means 300 further comprises a plurality of background 
40 image sub-region update means 200 provided in corre- 
spondence to a plurality of sub-regions a k for updating 
the image feature parameter value of each sub-region 
a k , and each background image sub-region update 
means 200 further includes an intensity change statis- 
ts tical processing means 210 (211, 212 in Fig. 4 for sub- 
regions a 1t a 2 ) for statistically processing the temporal 
change of the intensity at each sub-region during a pre- 
scribed period of time tg, an illumination change judging 
condition judgement means 220 (221, 222 in Fig. 4 for 
so sub-regions a 1 , a 2 ) for judging a need for updating the 
image feature parameter value at each sub-region due 
to an occurrence of the illumination change according 
to the statistically processed temporal change of the in- 
tensity at each sub-region, and a value update means 
55 230 (231 , 232 in Fig. 4 for sub-regions a, , ag) for updat- 
ing the image feature parameter value at each sub-re- 
gion according to the judgment result of the illumination 
change judging condition judgement means 220, so as 



4 



7 



EP 0 671 706 B1 



8 



to obtain a reconstructed new background image 310 
collectively. In Fig. 4, a sub-region with a value "1" in the 
reconstructed background image 310 represents the 
updated sub-region while a sub-region with a value "0" 
in the reconstructed background image 310 represents 
the unchanged (not updated) sub-region. 
[0045] In this first embodiment, the intensity change 
statistical processing means 211 (212) obtains a histo- 
gram 213 (214) of occurrences of intensity values at a 
pixel a 1 (a 2 ) and detect a peak and a variance o in the 
histogram 21 3 (2 1 4) as the statistical feature parameter, 
while the illumination change judging condition judg- 
ment means 221 (222) makes the judgment by compar- 
ing the detected variance a with a predetermined vari- 
ance o 0 indicating a threshold for separating a case due 
to the illumination change from a case due to the pass- 
ing of the moving object. 

[0046] The moving object extraction means 500 fur- 
ther comprises a subtraction means 400 for subtracting 
the reconstructed background image obtained by the 
background image region reconstruction means 300 
from the input image entered from the camera 001 in 
units of pixels, and a binarization means 510 for apply- 
ing a binarization using a prescribed threshold to a result 
of the subtraction obtained by the subtraction means 
400, and outputting the moving object output 520. 
[0047] Now, this moving object extraction system of 
Figs. 3 and 4 operates as follows. 
[0048] First, the monochromatic image sequence of 
the input images are entered from the camera 001 , and 
stored into the frame image memories 101, 102, etc. in 
the image feature parameter value temporal change 
storage means 1 00, where each input image contains a 
sub-region a k centered around a coordinate position (x, 
y). This sub-region a k may be a region comprising a plu- 
rality of pixels, but it is assumed to be a single pixel for 
the sake of simplicity in this first embodiment. Also, the 
image feature parameter at each sub-region is the in- 
tensity at each pixel given by 8 bit intensity value in this 
first embodiment. As a result, in the image feature pa- 
rameter value temporal change storage means 1 00, for 
each sub-region as many intensity values as a 
number of frames entered can be stored during the pre- 
scribed period of time t^. 

[0049] Then, the intensity change statistical process- 
ing means 21 1 obtains the histogram 21 3 of occurrenc- 
es of intensity values for the sub-region a 1 as shown in 
Fig. 4 by taking intensity values on a horizontal axis and 
a frequency of occurrences on a vertical axis. In the ex- 
ample shown in Fig. 4, this sub-region a 1 remains as a 
part of the background as it does not contain the moving 
object during the period of time \$. The intensity of the 
background mainly changes due to the illumination 
change, but when the period of time t^ is as short as 
several seconds, the illumination change during such a 
short period of time is generally small, so that the distri- 
bution of the intensity values in the histogram 21 3 takes 
a bell shape with a small variance o around the peak. 



[0050] On the other hand, the intensity change statis- 
tical processing means 212 obtains the histogram 214 
of occurrences of intensity values for the sub-region a 2 
as shown in Fig. 4, and this sub-region a 2 contains the 

5 moving object so that the intensity values largely change 
during the period of time tg and the distribution of the 
intensity values in the histogram 214 takes a spread 
shape with a large variance a around the peak. 
[0051] Then, each of the illumination change judging 

10 condition judgment means 221 and 222 compares the 
variance o obtained by the respective one of the inten- 
sity change statistical processing means 211 and 212 
with the predetermined variance a 0 indicating a thresh- 
old for separating a case due to the illumination change 

15 from a case due to the passing of the moving object. 
When the obtained variance o is less than the predeter- 
mined variance a 0 , the change of the intensity value at 
the respective sub-region is judged as due to the illumi- 
nation change, in which case it is decided that the inten- 
se sity value at the respective sub-region is to be updated. 
On the other hand, when the obtained variance o is 
greater than or equal to the predetermined variance a 0 , 
the change of the intensity value at the respective sub- 
region is judged as due to the cause other than the ill u- 

25 mination change, such as the passing of the moving ob- 
ject, in which case it is decided that the intensity value 
at the respective sub-region is not to be updated. 
[0052] Then, the value update means 231 and 232 
update the intensity of the sub-regions a, and a2 when- 

30 ever necessary. In this manner, the reconstructed back- 
ground image 310 is obtained by the background image 
sub-region update means 200 in units of sub-regions. 
This operation for updating the background image sub- 
region may be carried out over the entire frame of each 

35 input image, or within a desired region of each input im- 
age. 

[0053] Here, instead of using the predetermined var- 
iance 00 as the illumination change judging condition as 
described above, it is also possible to use a predeter- 

40 mined feature in the distribution shape of the histogram 
for a case of the illumination change as the illumination 
change judging condition such that a case of the illumi- 
nation change can be judged by comparing a feature in 
the distribution shape of the obtained histogram with the 

45 predetermined feature. 

[0054] It is also noted that the manner of updating the 
background image as described above is also applica- 
ble to a case other than the above described case of the 
pixel value change due to the illumination change. 

50 Namely, it is applicable to a case of gradually changing 
background object, or any other case which is clearly 
distinguishable from the change due to the passing of 
the moving object. For example, in a case of automati- 
cally monitoring movements of persons in an office, po- 

55 sitions of papers on desks can change irregularly, in 
clear distinction from the movements of the persons. 
That is, the papers move discontinuously as they remain 
unchanged after they are moved once until they are 



5 



9 



EP 0 671 706 B1 



10 



moved again, whereas the movements of the persons 
are generally continuous during the period of time t©. 
Consequently, by means of a comparison of the histo- 
gram, it is possible to distinguish the intensity change 
due to the moving object, i.e., the movement of the per- s 
son, from the others such as that due to the change of 
the positions of the papers. Therefore, the manner of 
updating the background image similar to that described 
above can be applied to such a case in a similar manner. 
[0055] The reconstructed background image 310 ob- 
tained in this manner can be considered as reflecting 
the most reliable state of the background immediately 
before the moving object appears. Thus, by utilizing the 
sequentially reconstructed background image at the 
moving object extraction means 500, in applying the 
subtraction processing and the binarization processing 
to the desired region in the input images by the subtrac- 
tion means 400 and the binarization means 510, it is 
possible to extract the moving object region 1 20, and by 
sequentially repeating this operation with respect to the 
sequentially entered input images, it is possible to obtain 
the moving object output 520 representing sequential 
images of the moving object as shown in Fig. 4. 
[0056] It is to be noted that the use of the monochro- 
matic camera and the intensity value at each pixel as 
the image feature parameter value as described above 
is only an example, and it is possible to modify the above 
described first embodiment to use the other image fea- 
ture parameter such as image concentration data ob- 
tained by a monochromatic camera, or data that can be 
extracted from color data obtained by a color camera 
such as the intensity, the hue, the saturation, the inten- 
sity gradient with respect to neighboring pixels, and oth- 
er quantities expressed in the chromaticness scale sys- 
tem. It is also possible to use concentration data or tem- 
perature data obtained by an infrared camera, distance 
data obtained by a range sensor, or reflection intensity 
data obtained by an ultrasonic sensor as the image fea- 
ture parameter. 

[0057] It is also to be noted that the sub-region may 
not necessarily be a single pixel as described above, 
and may be a block image formed by a plurality of pixels, 
in which case, the image feature parameter can be a 
value obtained by statistically processing a plurality of 
intensity values or other quantities qualifying as the im- 
age feature parameter, such as the mean value, the 
most frequent value, the maximum value, or the mini- 
mum value of the intensity values within the block im- 
age. 

[0058] In a case the mean value of the intensity values 
within the block image as the image feature parameter 
for instance, the operation up to the illumination change 
judging condition judgment means 221 and 222 are sim- 
ilar as described above, and the updating of the value 
at each sub-region in a case it is judged as a case of the 
illumination change can be carried out as follows. 
Namely, the block image corresponding to the intensity 
value at the peak of the histogram of occurrences of in- 



tensity values for this sub-region is selected from the 
frame images for the past period of time t^ stored in the 
image feature parameter value temporal change stor- 
age means 100, and the background value of this sub- 
region is replaced by the selected block image in the 
reconstructed background image 310. When this oper- 
ation is carried out over the desired region, the recon- 
structed background image 310 can be obtained se- 
quentially as described above. The operation at the 
moving object extraction means 500 is similar as de- 
scribed above. 

[0059] Referring now to Figs. 5A to 5D, the second 
embodiment of the moving object extraction based on 
background subtraction according to the present inven- 
tion will be described in detail. 
[0060] In the first embodiment of Figs. 3 and 4 de- 
scribed above, the desired region for applying the oper- 
ation for updating the background value has been as- 
sumed as the entire image frame, but in this second em- 
bodiment, this desired region is set to be a single line 
within an image frame, i.e., a sampling slit 720 in a form 
of a slit shaped pixel sequence within an image se- 
quence 710 as shown in Fig. 5A. 
[0061 ] Fig. 5B shows a space-time image 730 formed 
by the slit 720 in the image sequence 71 0 of Fig. 5A and 
a time axis, while Fig. 5C shows a graph 740 indicating 
the temporal change of the input value 742 and the 
background value 741 at a specific sampling position in 
the space-time image of Fig. 5B, and Fig. 5D shows a 
space-time image 750 indicating the extraction result of 
the moving object 751 . 

[0062] in this second embodiment, the sub-region is 
set to be a pixel in the image, and the desired region for 
applying the updating of the background value is set to 
be a single line of the sampling slit 720. By setting the 
desired region in this manner, the space-time image 730 
formed by the slit 720 and the time axis can be produced 
easily at high speed. Here, the image sequence 710 to 
be entered may not necessarily be a two dimensional 
image as shown in Fig. 5A, and can be a one dimen- 
sional slit image directly obtained by a range sensor or 
a line camera. 

[0063] Then, by applying the moving object extraction 
based on background subtraction as in the first embod- 
iment described above for the moving object within the 
slit shaped space-time image, it is possible to extract 
only the moving object 751 at very high speed, regard- 
less of the illumination change. 
[0064] More specifically, the operation in this second 
embodiment proceeds as follows. 
[0065] First, as shown in Fig. 5A, the slit 720 is pro- 
vided over the image sequence 710 containing passing 
persons which incorporates the illumination changes, 
and the obtained slit images are arranged along the time 
axis to obtain the space-time image 730 shown in Fig. 
5B. Then, as shown in Fig. 5C for a particular pixel, the 
appropriate background value 741 can be sequentially 
judging in accordance with the illumination changes, 
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without being influenced by the change of the input val- 
ue 742 due to the passing of the persons, by means of 
the proper updating of the background value as in the 
first embodiment described above. Then, by using the 
properly reconstructed background image, the space- s 
time image 750 with only the moving object 751 extract- 
ed as shown In Fig. 5D can be obtained stably at high 
speed, by means of the moving object extraction based 
on background subtraction as in the first embodiment 
described above. 

[0066] Next, the third embodiment of the moving ob- 
ject extraction based on background subtraction ac- 
cording to the present invention will be described in de- 
tail 

[0067] In the first embodiment described above, the 
variance a is compared with the predetermined variance 
a 0 in judging the illumination change, but in this third 
embodiment, either as a replacement of this or as a sup- 
plement of this, the fol towing scheme is adopted. Name- 
ly, in general, the change of the background image due 
to the causes other than the passing of the moving ob- 
ject such as the illumination change and the gradually 
changing background object takes place gradually, and 
the shapes of the histograms for such cases resemble 
each other. Consequently, in this third embodiment, in 
judging the need for the updating at each sub-region a 1 , 
the shape of the histogram for each sub-region a^ is com- 
pared with the shapes of the histograms for the other 
sub-regions in vicinity of that sub-region aj, and it is de- 
cided that the updating is necessary for that sub-region 
^ when the similar histogram shapes are dominant in 
vicinity of that sub-region aj. 

[0068] For example, in a case depicted in Fig. 4, the 
histogram shapes for the sub-regions , a^ and as will 
be similar to each other, so that the intensity changes in 
these sub-regions will be judged as those due to the il- 
lumination changes and therefore the background val- 
ues at these sub-regions will be updated, whereas the 
histogram shapes for the sub-regions a 2 and a 3 will be 
largely different from the others, so that the intensity 
changes in these sub-regions will be judged as those 
due to the passing of the moving object and therefore 
the background values at these sub-regions will not be 
updated. 

[0069] Next, with reference to Figs. 6 and 7, the fourth 
embodiment of the moving object extraction based on 
background subtraction according to the present inven- 
tion will be described in detail. 
[0070] Fig. 6 shows a system configuration of a mov- 
ing object extraction system in this fourth embodiment, 
while Fig. 7 shows a detailed functional configuration of 
the background image region reconstruction means 330 
in the moving object extraction system of Fig. 6. 
[0071] In Figs. 6 and 7, the system generally compris- 
es; a color camera 002 for entering an image sequence 
of the color input images; an image feature parameter 
value temporal change storage means 130 including 
three sets of frame image memories 131, 132, and 133 



for storing image feature parameter values for R, G, and 
B images in the sequentially entered color input images; 
a background image region reconstruction means 330 
for reconstructing the background image according to 
the temporal change of the stored image feature param- 
eter values; and a moving object extraction means 530 
for obtaining a moving object region 120 from the en- 
tered input image and the reconstructed background im- 
age. 

[0072] In further detail, each frame image memory in 
the image feature parameter value temporal change 
storage means 1 30 stores the image feature parameter 
values for each input image containing a background 
region 110 and a moving object region 120 which is di- 
vided into a plurality of sub-regions a^ such as pixels 
located at coordinate positions (x, y) within each frame. 
[0073] The background image region reconstruction 
means 330 further comprises a plurality of background 
image sub-region update means 204 provided in corre- 
spondence to a plurality of sub-regions a k for updating 
the image feature parameter value of each sub-region 
a k , and each background image sub-region update 
means 204 further includes an n -dimensional vector 
generation means 240 (n = 3 in this fourth embodiment) 
for generating n-dimensional feature vectors from the 
image feature parameter values at each sub-region for 
R, G and B images, and a value change statistical 
processing means 260 for statistically processing the 
temporal change of the image feature parameter values 
at each sub-region during a prescribed period of time t^. 
[0074] As shown in Fig. 7, the background image sub- 
region update means 204 receives a vector set 251 
(252) during the period of time tg at the respective sub- 
region a 1 (a 2 ) t and includes a statistical processing 
means 261 (262) for statistically processing distances 
W among the feature vectors in the vector set 251 (252), 
an illumination change judging condition judgement 
means 271 (272) for judging a need for updating the im- 
age feature parameter value at each sub-region due to 
an occurrence of the illumination change according to 
the statistical processing result at each sub-region, and 
a value update means 281 (282) for updating the image 
feature parameter value at each sub-region according 
to the judgment result of the illumination change judging 
condition judgement means 271 (272), so as to obtain 
a reconstructed new background image 321 collectively. 
[0075] The moving object extraction means 530 fur- 
ther comprises subtraction means 401 , 402, and 403 for 
subtracting the R, G, and B images in the reconstructed 
background image obtained by the background image 
region reconstruction means 330 from the R, G, and B 
images 011. 012, and 013 in the color input image en- 
tered from the color camera 002 in units of pixels, and 
a binarization means 511, 512, and 513 for applying a 
binarization using a prescribed threshold to the subtrac- 
tion results for the R, G, and B images, respectively. 
[0076] Now, this moving object extraction system of 
Figs. 6 and 7 operates as follows. 
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[0077] First, the color image sequence of the input im- 
ages are entered from the color camera 002, and the R, 
G, and B images (pixel values) are stored into the frame 
image memories 1 31 , 1 32, and 1 33 as the image feature 
parameters. Then, as indicated in Fig. 7, three types of s 
the pixel values for R, G, and B for each sub-region are 
given as a feature vector in a three-dimensional feature 
space for each sub-region at the n -dimensional vector 
generation means 240. The similar feature vectors are 
also plotted during the period of time \$ for each sub- io 
region, so as to obtain the vector set during tg for each 
sub-region a k , such as the vector set 251 (252) for the 
sub-region a A (a 2 ). 

[0078] Here, the vector set 251 (252) has the following 
feature. Namely, at the sub-region a 1 in which the mov- is 
ing object is absent, the feature vectors V1 , V2, and V3 
change only gradually over the period of time tg, and the 
distance W1 between the feature vectors V1 and V2 as 
well as the distance W2 between the feature vectors V2 
and V3 have small values. On the other hand, at the 20 
sub- region a^ in which the moving object is present, the 
feature vectors V1 , V2, and V3 change largely over the 
period of time tg, and the distance W1 between the fea- 
ture vectors V1 and V2 as well as the distance W2 be- 
tween the feature vectors V2 and V3 have large values. 2s 
[0079] Then, by using these distances W1 and W2 as 
the feature value IWI, the statistical processing means 
261 (262) obtains the histogram 263 (264) of occurrenc- 
es of feature values for the sub-region a^ (a£ as shown 
in Fig. 7 by taking the feature values on a horizontal axis 30 
and a frequency of occurrences on a vertical axis. As a 
result, the histogram 263 for the sub-region a 1 has a dis- 
tribution with a small variance o, whereas the histogram 
264 for the sub-region a 2 has a distribution with a large 
variance 0. *s 
[0080] Consequently, the illumination change judging 
condition judgment means 271 (272) compares the var- 
iance o obtained by the respective statistical processing 
means 261 (262) with the predetermined variance o 0 
indicating a threshold for separating a case due to the 40 
illumination change or a case due to the gradually 
changing background object from a case due to the 
passing of the moving object. When the obtained vari- 
ance o is less than the predetermined variance o 0 , the 
change of the intensity value at the respective sub-re- 4S 
gion is judged as due to the illumination change or the 
gradually changing background object, in which case it 
is decided that the intensity value at the respective sub- 
region is to be updated. On the other hand, when the 
obtained variance o is greater than or equal to the pre- so 
determined variance a 0 , the change of the intensity val- 
ue at the respective sub-region is judged as due to the 
cause other than the illumination change or the gradu- 
ally changing background object, such as the passing 
of the moving object, in which case it is decided that the ss 
intensity value at the respective sub-region is not to be 
updated. 

[0081] Then, the value update means 281 (282) up- 



dates the intensity of the sub-region a 1 (a 2 ) whenever 
necessary. In this manner, the reconstructed new back- 
ground image 321 is obtained by the background image 
sub-region update means 204 in units of sub-regions. 
Here, the reconstructed new background image 321 
contains R, G, and B images which are to be subjected 
to the subtraction processing and the binarization 
processing at the moving object extraction means 530 
in conjunction with the R, G, B images in the color input 
image, so as to extract the moving object region 120. 
[0082] In this fourth embodiment, a plurality (three) of 
image feature, parameters (pixel values for R, G, and 
B) are utilized in updating the background values and 
extracting the moving object, so that the judgment for a 
need to update the background value at each sub-re- 
gion can be made accurately, and the moving object can 
be extracted stably. 

[0083] It is to be noted that, instead of using the R, G, 
and B images obtained by the color camera as the im- 
age feature parameter values as described above, it is 
possible to modify the above described fourth embodi- 
ment to use the other image feature parameters that can 
be extracted from color data obtained by a color camera 
such as any combination of the intensity, the hue, the 
saturation, the intensity gradient with respect to neigh- 
boring pixels, and other quantities expressed in the 
chromaticness scale system. It is also possible to use 
any combination of concentration data or temperature 
data obtained by an infrared camera, distance data ob- 
tained by a range sensor, and reflection intensity data 
obtained by an ultrasonic sensor as the image feature 
parameters. 

[0084] It is also to be noted that the sub-region may 
not necessarily be a single pixel as described above, 
and may be a block image formed by a plurality of pixels, 
in which case, the image feature parameter can be a 
value obtained by statistically processing a plurality of 
intensity values or other quantities qualifying as the im- 
age feature parameter, such as the mean value, the 
most frequent value, the maximum value, or the mini- 
mum value of the intensity values within the block im- 
age. 

[0085] Next, with reference to Figs. 8, 9A and 9B, the 
fifth embodiment of the moving object extraction based 
on background subtraction according to the present in- 
vention will be described in detail. 
[0086] This fifth embodiment differs from the fourth 
embodiment described above only in that the the back- 
ground image sub- region update means 204 in the 
background image region reconstruction means 330 is 
replaced by the background image sub-region update 
means 205 in the background image region reconstruc- 
tion means 331 so as to obtain the reconstructed new 
background image 322. Fig. 8 shows a detailed func- 
tional configuration of the background image region re- 
construction means 331 in this fifth embodiment. 
[0087] In Fig. 8, the background image region recon- 
struction means 331 further comprises a plurality of 
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background image sub-region update means 205 pro- 
vided in correspondence to a plurality of sub-regions a k 
tor updating the image feature parameter value of each 
sub-region a k , and each background image sub-region 
update means 205 further includes the n-dimensbnal 
vector generation means 240 simitar to that in the fourth 
embodiment described above, a discrete set calculation 
means 253 (254) for calculating the discrete set with re- 
spect to the imaging system characteristic curve L1 (L2) 
during the period of time \$ at the sub-region a, (a^, a 
statistical processing means 265 (266) for statistically 
processing distances d (d1 , d2, d3) of the the feature 
vectors V1 , V2, and V3 from the characteristic curve L1 
(L2), an illumination change judging condition judge- 
ment means 273 (274) for judging a need for updating 
the image feature parameter value at each sub-region 
due to an occurrence of the illumination change accord- 
ing to the statistical processing result at each sub-re- 
gion, and a value update means 283 (284) for updating 
the image feature parameter value at each sub-region 
according to the judgment result of the illumination 
change judging condition judgement means 273 (274), 
so as to obtain a reconstructed new background image 
322 collectively. 

[0088] Now, the feature values used in this fifth em- 
bodiment will be described with reference to Figs. 9A 
and 9B, where (X1, X2, X3), (Y1, Y2, Y3), and (21, Z2, 
Z3) are three sets of input values in the respective sub- 
region, bO, b1 , and b2 are three background values in 
the respective sub-region, La, Lb, L0, L1 , and L2 are 
characteristic curves corresponding to the background 
values, and u2 and u3 are the motion vectors on the 
characteristic curve LO. 

[0089] In this fifth embodiment, the characteristic 
curve of the three-dimensional vectors which change in 
conjunction with the illumination change is obtained in 
advance according to the background values bO, b1 , 
etc. in each sub-region. Here, in order to simplify the 
processing, the change of the background value due to 
the illumination change can be assumed to occur along 
a straight line joining the current background value and 
the origin such that the characteristic curves can be ap- 
proximated by the straight lines La and Lb shown in Fig. 
9A. 

[0090] Here, the set of three feature vectors obtained 
by the discrete set calculation means 253 (254) has the 
following feature. Namely, at the sub-region a 1 in which 
the moving object is absent, the feature vectors V1 , V2, 
and V3 change only gradually from the characteristic 
curve L1 over the period of time t^, and the distances 
d1, d2, and d3 of the feature vectors V1, V2, and V3 
from the characteristic curve L1 have small values. On 
the other hand, at the sub-region in which the moving 
object is present, the feature vectors V1, V2, and V3 
change largely over the period of time t^ and the dis- 
tances d1 , d2, and d3 of the feature vectors V1 , V2, and 
V3 from the characteristic curve L2 have large values. 
[0091] Then, by using these distances d1 , d2, and d3 



as the feature value Idl, the statistical processing means 
265 (266) obtains the histogram 267 (268) of occurrenc- 
es of feature values for the sub-region a 1 (82) as shown 
in Fig. 8 by taking the feature values on a horizontal axis 
5 and a frequency of occurrences on a vertical axis. As a 
result, the histogram 267 for the sub-region a t has a dis- 
tribution with a small variance a, whereas the histogram 
268 for the sub-region a 2 has a distribution with a large 
variance o. 

10 [0092] Consequently, the illumination change judging 
condition judgment means 273 (274) compares the var- 
iance o obtained by the respective statistical processing 
means 265 (266) with the predetermined variance a 0 
indicating a threshold for separating a case due to the 

15 illumination change from a case due to the passing of 
the moving object. When the obtained variance a is less 
than the predetermined variance o 0 , the change of the 
intensity value at the respective sub-region is judged as 
due to the illumination change, in which case it is decid- 

20 ed that the intensity value at the respective sub-region 
is to be updated. On the other hand, when the obtained 
variance <j is greater than or equal to the predetermined 
variance a 0 , the change of the intensity value at the re- 
spective sub-region is judged as due to the cause other 

25 than the illumination change, such as the passing of the 
moving object, in which case it is decided that the inten- 
sity value at the respective sub-region is not to be up- 
dated. 

[0093] Then, the value update means 283 (284) up- 

30 dates the intensity of the sub-region a A (a^ whenever 
necessary. In this manner, the reconstructed new back- 
ground image 322 is obtained by the background image 
sub-region update means 205 in units of sub-regions. 
[0094] It is possible to modify the above described fifth 

35 embodiment to use a mean value of the distances d 
used as the feature values for the histogram instead of 
the variance a of the histogram in evaluating the spread 
of the feature values in the histogram, for the purpose 
of judging a case due to the illumination change. In this 

40 case, the mean value becomes small for the sub-region 
a1 whereas the mean value becomes large for the sub- 
region a2, so that by comparing the mean value of the 
feature values in the histograms with a predetermined 
mean value of the feature values for a case due to the 

45 illumination change, it becomes possible to judge a case 
due to the illumination change, for which the background 
updating is necessary, similarly as in a case of using the 
variance as described above. 

[0095] Moreover, it is also possible to judge the level 
50 of abruptness of the illumination change by utilizing the 
motion vector of a projection point on the characteristic 
curve of the displacement from the characteristic curve 
(i.e., a point at which a line perpendicular to the charac- 
teristic curve and passing through the current back- 
55 ground value intersects with the characteristic curve), in 
addition to the distance d from the characteristic curve, 
as follows. For example, in Fig. 9B, for the characteristic 
curves L0, L1 , and L2 corresponding to the background 
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values bO, b1 , and b2, the change of the feature vectors 
in each sub-region can be expressed in terms of the dis- 
tance d from the characteristic curve as well as the mo- 
tion vector u on the characteristic curve, such that a case 
of the abrupt illumination change (Y1, Y2, Y3) can be 
distinguished from a case of the gradual illumination 
change (Z1 , Z2, Z3) according to the motion vectors u, 
while distinguishing a case of the passing of the moving 
object (X1 , X2, X3) according to the distances d. 
[0096] Next, with reference to Figs. 10 and 11, the 
sixth embodiment of the moving object extraction based 
on background subtraction according to the present in- 
vention will be described in detail 
[0097] This sixth embodiment differs from the first em- 
bodiment described above only in that the the back- 
ground image sub-region update means 200 is replaced 
by the background image sub-region update means 
201. Fig. 10 shows a schematic configuration of the 
background image sub-region update means 201 in this 
sixth embodiment, while Fig. 11 shows a detailed func- 
tional configuration of the background image sub-region 
update means 201 in this sixth embodiment. 
[0098] As shown in Fig. 10, this background image 
sub-region update means 201 generally comprises an 
intensity change statistical processing means 215 for 
statistically processing the temporal change of the in- 
tensity at each sub-region during a prescribed period of 
time tg, and an illumination change judging condition 
judgement means 223 for judging a need for updating 
the image feature parameter value at each sub-region 
due to an occurrence of the illumination change accord- 
ing to a plurality of illumination change judging condi- 
tions on the statistically processed temporal change of 
the intensity at each sub-region, and a plurality of value 
update means 233 to 235 for updating the image feature 
parameter value at each sub-region according to the 
judgment result of the illumination change judging con- 
dition judgement means 223. 

[0099] In further detail, as shown in Fig. 1 1 , the inten- 
sity change statistical processing means 215 includes 
the statistical processing means 341 . 342, and 345 for 
statistically processing the temporal change of the in- 
tensity at the respective sub-regions , a 2 , and as dur- 
ing a prescribed period of time tg, by using the histo- 
grams 351 , 352, and 355 of occurrences of intensity val- 
ues during the period of time t0 at the respective sub- 
regions a t , a 2 , and a 5 to obtain the variances o 1 , o 2 , and 
a 5 in the respective sub-regions a-,, a 2 , and a 5 , as well 
as the histograms 361 , 362, and 365 of occurrences of 
temporal differential of intensity values during the period 
of time t 0 at the respective sub-regions a 1t a 2 , and a 5 to 
obtain the maximum values m-,, m 2 , and m 5 of the tem- 
poral differential of the intensity value during the period 
of time t 0 in the respective sub-regions a 1 , a 2 , and a 5 . 
The illumination change judging condition judgement 
means 223 judges a need for updating the image feature 
parameter value at each sub-region due to an occur- 
rence of the illumination change according to the prede- 



termined variance o 0 and the predetermined maximum 
value m 0 for the temporal differential of the intensity val- 
ue. Among a plurality (two in Fig. 1 1 ) of the value update 
means 233 and 235, the value update means I 233 is 
s used for a case of the gradual illumination change, while 
the value update means II 235 is used for a case of the 
abrupt illumination change. 

[01 00] Now, in the first embodiment described above, 
whether or not to update the image feature parameter 

J0 value at each sub-region has been decided according 
to whether the illumination change judging condition is 
satisfied or not. However, the illumination change can 
include various manners of changes depending on the 
causes of the changes, so that in this sixth embodiment, 

15 different manners of updating the image feature param- 
eter values are used for different types of the illumination 
changes, such that the background image can be recon- 
structed properly in accordance with a type of the illu- 
mination change which is judged by using a plurality of 

20 illumination change judging conditions. 

[0101] Namely, when there is no illumination change 
or when there is only a gradual illumination change, the 
histograms 351 and 361 as shown in Fig. 11 will be ob- 
tained, so that the variance a and the maximum value 

25 m during the period of time tg is small as long as the 
period of time \q is as short as several seconds. 
[0102] As the illumination change becomes more 
abrupt, the variance o increases accordingly, and it be- 
comes difficult to distinguish a case of the illumination 

30 change and a case of the cause other than the illumina- 
tion change according to the value of the variance a 
alone, as can be seen in the histogram 355 for a case 
of the abrupt illumination change and the histogram 352 
for a case of the cause other than the illumination 

35 change. In order to distinguish these two cases, the 
maximum value m of the temporal differential df of the 
intensity value can be used, as this temporal differential 
df takes a small value for a case of the illumination 
change and a large value for a case of the passing of 

40 the moving object, as can be seen in the histogram 365 
for a case of the abrupt illumination change and the his- 
togram 362 for a case of the case other than the illumi- 
nation change. In particular, this temporal differential df 
takes particularly large values at a moment of the entry 

45 of the moving object into the image and at a moment of 
the exit of the moving object from the image. 
[0103] Thus, by using the predetermined maximum 
value m 0 for separating a case of the abrupt illumination 
change and a case of the passing of the moving object 

50 along with the predetermined variance o 0 , the illumina- 
tion change judging condition judgment means 223 
compares the obtained variance a and maximum value 
m with the predetermined variance o 0 and maximum 
value m 0 , and judges it as a case of the gradual illumi- 

55 nation change when the obtained variance o and max- 
imum value m are less than the predetermined variance 
o 0 and maximum value m^, respectively, or as a case 
of the abrupt illumination change when the obtained var- 
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iance o is greater than the predetermined variance o 0 
but the obtained maximum value m is less than the pre- 
determined maximum value m 0t or else as a case of the 
passing of the moving object when the obtained vari- 
ance o and maximum value m are greater than the pre- 
determined variance o 0 and maximum value nr^, re- 
spectively. In a case of the gradual illumination change, 
the background value at each sub-region is updated by 
the value update means I 233, and in a case of the 
abrupt illumination change, the background value at 
each sub-region is updated by the value update means 
II 235, whereas in a case of the passing of the moving 
object, the background value at each sub-region is not 
updated. 

[0104] Here, the value update means 1 233 for a case 
of no illumination change or the gradual illumination 
change can replace the background value at each sub- 
region by the most frequency value of the intensity val- 
ues during the period of time tg, while the value update 
means II 235 for a case of the abrupt illumination change 
can replace the background value at each sub-region 
by the mean value of the pixel values at each sub-region 
in several recent frames. 

[01 05] N ext. with reference to Figs. 1 2, 1 3A, 1 3B, 1 4A 
and 14B, the seventh embodiment of the moving object 
extraction based on background subtraction according 
to the present invention will be described in detail. 
[01 06] Fig. 1 2 shows a system configuration of a mov- 
ing object extraction system in this seventh embodi- 
ment, which generally comprises: a camera 001 for en- 
tering an image sequence of the input images; an image 
feature parameter value temporal change storage 
means 1 03 including frame image memories for storing 
image feature parameter values for the sequentially en- 
tered input images; a background image region recon- 
struction means 300 for reconstructing the background 
image according to the temporal change of the stored 
image feature parameter values; and a moving object 
extraction means 501 for obtaining a moving object out- 
put 520 from the stored image 020 at a prescribed period 
of time tf earlier timing and the reconstructed back- 
ground image 310. 

[0107] As shown in Fig. 13A, in the first embodiment 
described above, the image 010 to be supplied to the 
moving object extraction means 500 and subjected to 
the subtraction processing at the subtraction means 400 
with respect to the reconstructed background image 310 
has been the latest input image 601 among the image 
sequence 600 entered from the camera 001 . In contrast, 
as shown in Fig. 13B, in this seventh embodiment, the 
image 020 to be supplied to the moving object extraction 
means 501 and subjected to the subtraction processing 
at the subtraction means 401 with respect to the recon- 
structed background image 310 is set to be the input 
image at the prescribed period of time t t earlier timing 
among the image sequence 600 entered from the cam- 
era 001 . 

[0108] Thus, this seventh embodiment differs from 



the first embodiment described above in that the input 
image used in the subtraction processing is different. 
More specifically, the input image used in the subtrac- 
tion processing at the subtraction means 400 in the first 

s embodiment described above has been the image 010 
entered from the camera 001 at the immediately before 
the subtraction processing is to be carried out, whereas 
the input image used in the subtraction processing at 
the subtraction means 401 in this seventh embodiment 

10 is the image 020 which had been entered from the cam- 
era 001 at the timing which is the prescribed period of 
time t 1 before the subtraction processing is to be carried 
out and which has been stored in the image feature pa- 
rameter value temporal change storage means 103. 

15 [01 09] The images stored in the image feature param- 
eter value temporal change storage means 103 are uti- 
lized not just in the subtraction processing, but also in 
the background updating processing at the background 
image region reconstruction means 300 as in the first 

20 embodiment described above. Here, the prescribed pe- 
riod of time t 0 used in the background updating process- 
ing is set to be longer than the prescribed period of time 
\, used in the subtraction processing. In other words, 
from the point of view of the image 020, the subtraction 

2$ processing using the image 020 is going to be carried 
out with respect to the reconstructed background image 
310 which has been reconstructed according to the im- 
ages ranging from the image entered at \$ -tj earlier tim- 
ing (i.e., a past image with respect to the image 020) to 

30 the image entered at t, later timing (i.e., a future image 
with respect to the image 020) in this seventh embodi- 
ment. 

[011 0] Figs. 14A and 1 4B show the temporal change 
602 of the intensity value in a case of the gradually 

35 brightening illumination change for the first embodiment 
described above and this seventh embodiment, respec- 
tively, along with the subtraction processing target im- 
age intensity level 603 or 605 for a certain sub-region 
and the judging background image intensity level 604 

40 or 606 for the same sub-region judging by using the im- 
ages within a given period of time, where the horizontal 
axis represents time and the vertical axis represents the 
intensity value. 

[0111] As already mentioned above, in this seventh 
45 embodiment, the images subjected to the subtraction 
processing are the image 020 at the prescribed period 
of time t t earlier timing than the current timing, and the 
reconstructed background image 310 which has been 
reconstructed according to the images ranging from the 
so image entered at t 0 -t 1 earlier timing than the image 020 
to the image entered at t, later timing than the image 
020. Here, in a case the illumination change judging 
condition judgment means 220 judges the occurrence 
of the illumination change, the value update means 239 
55 updates the background value at each sub-region to a 
new background value which is equal to the mean value 
of the intensity values in all the images during a certain 
period of time t 2 centered around the timing tj of the im- 
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age 020 as indicated in Fig. 14B, such that the recon- 
structed background image 310 have the background 
values judging according to the images ranging from the 
image entered at tg-tj * n P ast witn respect to the image 
020 to the image entered at t, in future with respect to 
the image 020. The period of time tg used in this value 
updating processing is set to be shorter than the pre- 
scribed period of time t, used in the subtraction process- 
ing. 

[0112] As shown in Fig. 14A, in the first embodiment 
described above, there is no image newer than the sub- 
traction processing target image, so that the back- 
ground image intensity level 604 corresponding to the 
subtraction processing target image intensity level 603 
is going to be judging by using only the images at earlier 
timings than the subtraction processing target image, 
and consequently there is a significant gap between the 
background image intensity level 604 and the subtrac- 
tion processing target image intensity level 603. 
[0113] In contrast, as shown in Fig. 14B, in this sev- 
enth embodiment, there are images newerthan the sub- 
traction processing target image, and it can be recog- 
nized that the intensity values are changing in a single 
direction (from dark to bright) in a vicinity of the subtrac- 
tion processing target image, so that by estimating the 
background image intensity level 606 corresponding to 
the subtraction processing target image intensity level 
605 by using the images ranging from the past image to 
the future image with respect to the the subtraction 
processing target image, it is possible to obtain the 
background image intensity level 606 which is much 
closer to the subtraction processing target image inten- 
sity level 605. 

[0114] Next, with reference to Figs. 15, 16A, 16B, and 
16C, the eighth embodiment of the moving object ex- 
traction based on background subtraction according to 
the present invention will be described in detail. 
[01 1 5] Fig. 1 5 shows a system configuration of a mov- 
ing object extraction system in this eighth embodiment, 
which differs from the first embodiment described above 
in that there is provided a threshold setting means 700 
for setting the threshold to be used at the binarization 
means 512 in the moving object extraction means 502 
according to the result of the statistical processing ob- 
tained by the intensity change statistical processing 
means 210 in the background image region reconstruc- 
tion means 200. The rest of this configuration Fig. 1 5 is 
identical to that of the first embodiment described 
above. 

[0116] When the binarization means512binarizesthe 
subtraction image obtained by the subtraction means 
400 from the input image and the reconstructed back- 
ground image in order to extract the moving object, there 
are cases in which the extraction precision can be im- 
proved by setting the threshold for the binarization to be 
a smaller value when the intensity values in the input 
image and the background image are small (dark) and 
to be a larger value when the intensity values in the input 



image and the background image are large (bright). For 
this reason, in this eighth embodiment, the threshold 
setting means 700 updates the threshold for each sub- 
region, according to the statistical information obtained 

s for each sub-region by the intensity change statistical 
processing means 210, so as to adjust the threshold 
used in the binarization means 512 for binarizing the 
subtraction image for each sub-region appropriately. In 
this manner, it becomes possible to carry out the moving 

10 object extraction stably, regardless of the brightness in 
each sub-region. Here, the updating of the threshold for 
each sub-region according to the statistical information 
for each sub-region can be realized by updating the 
threshold for each sub-region according to the intensity 

is value in the background image for each sub-region, as 
the intensity value in the sequentially updated back- 
ground image for each sub-region in turn is determined 
in accordance with the statistical information for each 
sub-region. 

20 [0117] Figs. 1 6A, 1 6B, and 1 6C show exemplary set- 
tings of the threshold by the threshold setting means 700 
according to the intensity value in the background image 
which in turn depends on the statistical information ob- 
tained for each sub-region by the intensity change sta- 

25 tistical processing means 210, where the horizontal axis 
represents the background image intensity value and 
the vertical axis represents the absolute value of the dif- 
ference obtained by the subtraction processing. More 
specifically, Fig. 16A shows a setting which is propor- 

30 tional to the background image intensity value, Fig. 1 6B 
shows a setting which is also proportional to the back- 
ground image intensity value but the threshold has a 
certain lower limit such that the threshold has some non- 
zero value even for the darkest background image in- 

35 tensity value, and Fig. 1 6C shows a setting which is pro- 
portional to the background image intensity values dark- 
er than a certain background image intensity value but 
the threshold becomes constant for the background im- 
age intensity values brighter than that certain back- 

40 ground image intensity value. 

[0118] Now, with reference to Figs. 17 to 22, exem- 
plary physical configurations for the apparatus to carry 
out the method of moving object extraction based on 
background subtraction as described in the first to 

45 eighth embodiments will be described in detail. 

[0119] First, Fig. 17 shows a physical configuration 
suitable for the first embodiment of Fig. 3. This configu- 
ration of Fig. 17 comprises an image input unit 171 func- 
tioning as the camera 001 of Fig. 3, an image storage 

50 unit 172 functioning as the image feature parameter val- 
ue temporal change storage means 100 of Fig. 3, a plu- 
rality of background update units 173a, 173b, 173c, etc. 
functioning as the background image sub-region update 
means 200 of the background image region reconstruc- 
ts tion means 300 of Fig. 3, an image subtraction calcula- 
tion unit 174 functioning as the subtraction means 400 
of Fig. 3, an image binarization calculation unit 1 75 func- 
tioning as the binarization means 510 of Fig. 3, and a 
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moving object output unit 1 76 for outputting the moving 
object output 520 of Fig. 3. The background update unit 
1 73a further includes a pixel value statistical processing 
unit 1731 functioning as the intensity change statistical 
processing means 210 of Fig. 3, a statistical value 
judgement unit 1732 functioning as the illumination 
change judging condition judgment unit 220 of Fig. 3, a 
most frequent value calculation unit 1733 connected 
with a value update unit 1734 and a mean value calcu- 
lation unit 1735 connected with a value update unit 1 736 
which function as the value update means 230 of Fig. 
3. Each of the other background update units 173b, 
173c, etc. also has similar internal configuration as the 
background update unit 173a. 
[0120] This physical configuration of Fig. 17 is also 
suitable for the third, fourth, fifth, and sixth embodiments 
described above. 

[0121] Next, Fig. 18 shows a physical configuration 
suitable for the second embodiment. This configuration 
of Fig. 18 differs from the configuration of Fig. 1 7 in that 
there is provided a slit image acquisition unit 1 81 for ac- 
quiring the slit image, which is located between the im- 
age input unit 171 and the image storage unit 172. 
[0122] Next, Fig. 19 shows a physical configuration 
suitable for the seventh embodiment of Fig. 12. This 
configuration of Fig. 19 differs from the configuration of 
Fig. 1 7 in that an image storage unit 1 91 is provided be- 
tween the image input unit 171 and the image subtrac- 
tion calculation unit 174, as well as between the image 
input unit 171 and the background update units 173, 
such that the images stored in the image storage unit 
191 can be supplied to the image subtraction calculation 
unit 174 as well as the background update units 173. 
[0123] Next, Fig. 20 shows a physical configuration 
suitable for the eighth embodiment of Fig. 1 5. This con- 
figuration of Fig. 20 differs from the configuration of Fig. 
17 in that there is provided a value setting unit 177 for 
setting the threshold to be used in the image binarization 
calculation unit 175, which is located between the pixel 
value statistical processing unit 1731 of each back- 
ground update unit 173 and the image binarization cal- 
culation unit 175. 

[0124] It is to be noted that the configuration of Fig. 
17 described above may be modified as shown in Fig. 
21 , where there is provided a background image storage 
unit 1 78 for storing the reconstructed background im- 
age, which is located between the background update 
units 173 and the image subtraction calculation unit 174, 
and each background update unit 173 incorporates a 
background value read out unit 1737 for reading out the 
background value from the statistical value judgement 
unit 1732 by bypassing the most frequent value calcu- 
lation unit 1733 and the mean value calculation unit 
1735, in response to a control from the background im- 
age storage unit 178. Here, the value update unit 1734 
is shared among the most frequent value calculation unit 
1733, the mean value calculation unit 1735, and the 
background value read out unit 1737. 



[0125] it is also to be noted that the various embodi- 
ments described above may be modified to additionally 
judge whether the updating of the background image it- 
self is to be carried out or not, such that the background 

5 image updating processing can be omitted altogether in 
a case of no background change. 
[0126] In such a case, the configuration of Fig. 21 can 
be modified further as shown in Fig. 22, where the sta- 
tistical value judgement unit 1732 makes the above not- 

10 ed additional judgement as to whether the updating of 
the background image itself is to be carried out or not, 
and when it is judged that the updating of the back- 
ground image is not to be carried out, the most frequent 
value calculation unit 1733, the mean value calculation 

is unit 1 735, and the value update unit 1 734 are bypassed. 
[0127] As described, according to the first embodi- 
ment described above, the background image is treated 
as a set of sub-regions such as pixels, and whether the 
value change of the image feature parameter value in 

20 each sub-region is due to the illumination change or due 
to the passing of the moving object is judged by statis- 
tically processing the temporal change of the image fea- 
ture parameter value. The illumination change in the 
outdoor site is usually caused by the passing of the 

25 cloud in the sky, the change of the position of the sun* 
the change of the shadow, etc., and mainly comprised 
of the intensity value change. In addition, the value 
change due to the illumination change is usually gradual 
compared with the change due to the passing of the 

30 moving object such as a human being or an automobile, 
so that by measuring the statistical quantity such as the 
variance according to the image feature parameter val- 
ues within a prescribed period of time, it is possible to 
detect the occurrence of the value change due to the 

3S illumination change at each sub-region. 

[0128] Strictly speaking, the illumination change is 
more or less present always, so that by carrying out the 
above processing continuously, it is possible to update 
the background image regularly in units of a prescribed 

40 period of time. 

[01 29] Also, as the updating processing is carried out 
for each sub-region, a region for applying this updating 
processing can be expanded to any desired region with- 
in the image. Consequently, even if the illumination 

45 change is not uniform over the entire image, it is possible 
to update the background image appropriately. 
[0130] Moreover, in the subtraction image between 
the updated background image and the input image, the 
image feature parameter value changes at a region 

50 where the moving object is present, so that this moving 
object region can be stably detected by using appropri- 
ate thresholding. 

[01 31] Furthermore, in updating the image feature pa- 
rameter value at each sub-region, the extreme value or 
55 the mean value of the histogram over a prescribed pe- 
riod of time corresponding to the value at each sub-re- 
gion is used, so that the statistically most likely back- 
ground value at that moment is used in updating, and 
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therefore the subsequent subtraction processing and bi- 
narization processing can be stabilized. In addition, it is 
possible to avoid the influence of the value fluctuation 
due to the imaging noise and other noise factors. 
[01 32] Also, according to the second embodiment de- 
scribed above, the sub-region is set to be a pixel in the 
image, and the desired region for applying the back- 
ground updating processing is set to be a single line (slit) 
in the image, so that the space-time image formed by 
that line and the time axis can be produced easily at high 
speed. In this case, as a result of the subtraction 
processing, only the moving object remains in this 
space-time image, so that the binarization processing 
can also be carried out at high speed. 
[0133] Also, according to the third embodiment de- 
scribed above, the statistical quantity such as the vari- 
ance in the histogram of the values in each sub-region 
is relatively compared with the statistical quantity such 
as the variance in the histograms of the values in other 
sub-regions in a vicinity of that sub-region. In general, 
the change of the background image due to the illumi- 
nation change is gradual not just in the time direction 
but also in the space direction as well. Consequently, by 
relatively comparing the change in one sub-region with 
the changes in the surrounding sub-regions, it is possi- 
ble to carry out the updating processing by judging the 
change as that due to the illumination change when the 
change is judged to be uniform over an appropriate re- 
gion on the image. 

[0134] Also, according to the fourth embodiment de- 
scribed above, the presence or absence of the illumina- 
tion change is judging by the statistical processing of the 
value changes in n types of the image feature parameter 
values, so that the background updating processing can 
be carried out more stably In addition, the change in the 
background can be analyzed more minutely by using a 
plurality of feature quantities, so that not just a case of 
the image change due to the illumination change, but 
also a case of the gradually changing background can 
also be detected and the appropriate updating can be 
carried out. 

[0135] Moreover, the histogram of the distances of 
each feature vector between frames is obtained, and the 
presence or absence of the illumination change is de- 
tected from the statistical quantity such as the variance 
of this histogram. In a case of the illumination change, 
the vector distances between frames are relatively 
small, whereas even the distance between two vectors 
in one frame becomes large in a case of the passing of 
the moving object. Consequently, a case of the illumi- 
nation change can be detected from this histogram, and 
the gradual change of the background can also be de- 
tected, from this histogram. 

[0136] Also, according to the fifth embodiment de- 
scribed above, the characteristic curve ofthe n-dimen- 
sional feature vectors which change in conjunction with 
the illumination change is determined in advance. As 
mentioned above, the change due to the illumination 



change is mainly the intensity value change, and in a 
case of the intensity value change, the feature vectors 
move substantially along the predetermined character- 
istic curve. Thus, when it is judged that the feature vec- 

s tors are substantially moving along this characteristic 
curve, it can be judged as a case of the illumination 
change and the background updating processing can 
be carried out accordingly On the other hand, in a case 
of the passing of the moving object, the feature vectors 

10 largely deviate from the characteristic curve. Conse- 
quently, a case of the passing of the moving object can 
be clearly distinguished from a case of the illumination 
change. 

[0137] In making the above judgment, the histogram 

J5 of distances of the feature vectors from the characteris- 
tic curve is used. As noted above, the feature vectors 
do not deviate largely from the the characteristic curve 
in a case of the illumination change in general, so that 
the mean value of the distances is going to be small, 

20 and the variance is also not going to be very large. On 
the other hand, in a case of the passing of the moving 
object, the distances are going to be large and the var- 
iance is also going to be large. Thus, these two cases 
can be distinguished according to these differences. 

25 Here, by using the mean value and the variance in com- 
bination, it is possible to improve the reliability of the 
judgment. In addition, when the characteristic curve it- 
self has changed as the background has changed for 
some reason, it is possible to generate the characteristic 

30 curve for a case of the illumination change in corre- 
spondence to the new background by estimating the 
change of the background. 

[0138] Also, according to the sixth embodiment de- 
scribed above, a plurality of illumination change judging 

35 conditions are used, so that the background updating 
processing can be carried out according to the manner 
of the illumination change, and it is possible to carry out 
the moving object extraction accounting for various 
types of the illumination changes. 

40 [0139] Also, according to the seventh embodiment 
described above, the subtraction processing is carried 
out for the updated background image and the stored 
past input image, and this past input image is one of the 
images within the prescribed period of time t© used in 

45 the updating processing, so that the updated back- 
ground image can be more stable with respect to the 
illumination change and the change of the background 
itself in this subtraction processing with respect to the 
stored past input image, compared with a case of the 

so subtraction processing with respect to the latest input 
image. 

[0140] Moreover, the background image is updated 
by using the mean of the images centered around the 
subtraction processing target image, within a relatively 
S5 short period of time t^ so that even in a case of the 
abrupt illumination change, the background image can 
be updated stably, and in addition, the subtraction 
processing is carried out between the updated back- 



14 



27 



EP 0 671 706 B1 



28 



ground image and the image for which the background 
can be expected to be closest, so that the stable sub- 
traction processing can be realized. 
[0141] Also, according to the eighth embodiment de- 
scribed above, the threshold used in the binarization 
processing subsequent to the subtraction processing is 
varied according to the illumination condition at each 
sub-region in the image, so that the binarization 
processing can be carried out stably with respect to the 
change of the intensity value difference between the 
background image and the image to be extracted 
caused by the change in the brightness due to the illu- 
mination condition. 

[0142] In summary, according to the moving object 
extraction based on background subtraction according 
to the present invention, the following advantageous 
technical effects can be achieved. 

(1) As the occurrence of the illumination change can 
be detected accurately, the background image can 
be updated accordingly at that point. Consequently, 
it is possible to realize the moving object extraction 
based on background subtraction which is quite ro- 
bust against the illumination changes. 

(2) It is possible to update the background image 
even in a case of the gradual background change. 
Consequently, it is possible to realize the stable 
moving object extraction. 

(3) As the processing required in the present inven- 
tion is simple, it can be carried out at high speed. In 
addition, it can be implemented in hardware to re- 
alize even faster processing such as the real time 
processing. 

(4) The present invention can be utilized in a wide 
range of fields requiring the moving object extrac- 
tion. In particular, it is suitable for the extraction of 
the human being and the automobile. As the 
present invention can stably detect the passing of 
the moving object, it is effective in the applications 
such as an intruder monitoring at a manufacturing 
plant facility and a safety monitoring in a traffic fa- 
cility such as a platform at a station. 

(5) By combining the slit image, the present inven- 
tion can be utilized for counting of passing persons, 
in which case it is possible to extract the passing 
person regardless of the weather and the time of 
the measurement location, without being influenced 
by the noises originating from the imaging system 
such as a camera or the image transfer system, so 
that the accuracy in counting can be improved con- 
siderably. 

(6) The present invention almost never lose a sight 
of a target moving object, so that it can be utilized 
effectively for the detection of the trajectory of the 
moving object by consecutively carrying out the 
moving object extraction over the entire image field. 

(7) It is possible to update the background image 
appropriately both in a case of the gradual back- 



ground change and in a case of the abrupt back- 
ground change. Consequently, it is possible to re- 
alize the stable moving object extraction. 

(8) As it is possible to update the background image 
5 stably even in a case of the abrupt illumination 

change, it is possible to realize the stable moving 
object extraction even in a case of the abrupt illu- 
mination change. 

(9) As the background updating processing is sim- 
10 pie, it can be carried out at high speed. This fact is 

particularly effective in a case of the abrupt illumi- 
nation change. 

(10) It is possible to realize the binarization suitable 
for the region extraction at the dark portion as well 

is as at the bright portion, without being influenced by 
the local difference in brightness, so that it is possi- 
ble to realize the stable moving object extraction 
even in a case involving brightness irregularity in 
the target region or in a case involving a large tem- 

20 poral change in brightness. 

[0143] It is to be noted that many modifications and 
variations of the above embodiments may be made 
without departing from the novel and advantageous f ea- 
2S tures of the present invention. Accordingly, all such 
modifications and variations are intended to be included 
within the scope of the appended claims. 



so Claims 

1. A method of moving object extraction based on 
background subtraction, comprising the steps of: 

3$ (a) sequentially entering input images contain- 

ing a moving object region to be extracted; 

(b) storing temporal changes of image feature 
parameter values for sub-regions subdividing a 
frame of each input image entered, at the step 

40 (a); 

(c) statistically processing a temporal change 
of the image feature parameter values for each 
sub-region within a prescribed target region of 
the frame stored at the step (b) over a pre- 

45 scribed period of time tg to obtain at least one 

statistical quantity characterizing said temporal 
change, judging whether said temporal change 
is due to an illumination change or not accord- 
ing to said statistical quantity and a prescribed 
so illumination change judging condition, and up- 

dating a background image value for said each 
sub-region by a new background image value 
according to the image feature parameter val- 
ues for said each sub-region during the pre- 
ss scribed period of time t^ so as to obtain a re- 
constructed background image; 

(d) applying a subtraction processing to one of 
the input images entered at the step (a) and the 
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reconstructed background image obtained at 
the step (c) to obtain a subtraction image; and 
(e) applying a binarization processing to the 
subtraction image obtained at the step (d) to ex- 
tract the moving object region from the input im- s 
ages entered at the step (a). 

2. The method of claim 1, wherein at the step (c), 
whether said temporal change is due to the illumi- 
nation change or not is judged by obtaining a histo- io 
gram of the image feature parameter values for said 
each sub-region over the prescribed period of time 

tg, obtaining said statistical quantity from said his- 
togram, and comparing said statistical quantity with 
a predetermined reference statistical quantity rep- is 
resenting a case of the illumination change. 

3. The method of claim 1 , wherein at the step (c), the 
new background image value is either one of an ex- 
treme value and a mean value of the image feature 20 
parameter values for said each sub-region over the 
prescribed period of time t^ . 

4. The method of claim 1 , wherein at the step (c), said 
each sub-region is a pixel in the frame, and said pre- 25 
scribed target region is a slit shaped region in the 
frame. 

5. The method of claim 1, wherein at the step (c), 
whether said temporal change is due to the illumi- 30 
nation change or not is judged by obtaining a histo- 
gram of the image feature parameter values for said 
each sub-region over the prescribed period of time 

t^, obtaining said statistical quantity from said his- 
togram, and relatively comparing said statistical as 
quantity for said each sub-region with statistical 
quantities for other sub-regions in a vicinity of said 
each sub-region. 

6. The method of claim 1 , wherein at the step (b), the 40 
image feature parameter values of n types of image 
feature parameters for the sub-regions are stored 
with respect to the input images sequentially en- 
tered at the step (a), where n is an integer greater 
than one, and at the step (c), whether said temporal 45 
change is due to the illumination change or not is 
judged by forming n-dimensional feature vectors 
from the image feature parameter values of said n 
types of the image feature parameters for said each 
sub-region over the prescribed period of time fo, ob- so 
taining said statistical quantity by statistically 
processing a set of said n-dimensional feature vec- 
tors, and judging whether said statistical quantity 
satisfies the predetermined illumination change 
judging condition. ss 

7. The method of claim 6, wherein at the step (c), 
whether said temporal change is due to the illumi- 



nation change or not is judged by obtaining a histo- 
gram of distances between frames of each of said 
n-dimensional feature vectors over the prescribed 
period of time t^, obtaining said statistical quantity 
from said histogram, and comparing said statistical 
quantity with a predetermined reference statistical 
quantity representing a case of the illumination 
change. 

8. The method of claim 6, wherein at the step (c), 
whether said temporal change is due to the illumi- 
nation change or not is judged by obtaining in ad- 
vance a characteristic curve of said n-dimensional 
vectors for said each sub-region indicating a man- 
ner by which said n-dimensional vectors change in 
a case of the illumination change, obtaining a his- 
togram of distances between said characteristic 
curve and said n-dimensional feature vectors, ob- 
taining said statistical quantity from said histogram, 
and comparing said statistical quantity with a pre- 
determined reference statistical quantity represent- 
ing a case of the illumination change. 

9. The method of claim 8, wherein at the step (c), said 
statistical quantity is at least one of a mean value 
of the distances in said histogram and a variance of 
said histogram. 

10. The method of claim 8, wherein the step (c) also 
judges whether the illumination change is gradual 
or abrupt according to a motion vector of a point pro- 
jecting each of said n-dimensional vectors for said 
each sub-region onto said characteristic curve. 

11 . Trie method of claim 1 , wherein at the step (c), the 
prescribed illumination change judging condition in- 
cludes a plurality of conditions for specifying a plu- 
rality of different manners to update the background 
image value for said each sub-region. 

12. The method of claim 1 , wherein at the step (d), the 
subtraction processing is applied to a latest one of 
the input images entered at the step (a) and the re- 
constructed background image obtained at the step 
(c). 

13. The method of claim 1 , wherein at the step (d), the 
subtraction processing is applied to one of the input 
images entered at a prescribed period of time tj ear- 
lier than a current timing by the step (a) and the re- 
constructed background image obtained at the cur- 
rent timing by the step (c). 

14. The method of claim 1 3, wherein at the step (c), the 
new background image value is a mean value of the 
image feature parameter values for said each sub- 
region over a prescribed period of time t 2 centered 
around a timing which is the prescribed period of 
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time X A earlier than the current timing. 

15. The method of claim 1, wherein at the step (e), a 
threshold used in the binarization processing is set 
to be different for different sub-regions. 

1 6. The method of claim 1 5, wherein at the step (e), the 
threshold used in the binarization processing for 
said each sub-region is sequentially updated ac- 
cording to a value obtained by statistically process- 
ing the temporal change of the image feature pa- 
rameter values for said each sub-region over the 
prescribed period of time V 

17. The method of claim 1 , further comprising the steps 
of judging whether there is any change in the back- 
ground image according to the temporal change of 
the image feature parameter values stored at the 
step (b), and omitting an operation to update the 
background image value at the step (c) when it is 
judged that there is no change in the background 
image. 

18. The method of claim 1 , wherein at the step (c), said 
statistical quantity is at least one of a variance and 
a distribution shape of a histogram of the image fea- 
ture parameter values for said each sub-region over 
the prescribed period of time V 

1 9. The method of claim 1 8, wherein at the step (c), said 
statistical quantity further includes a maximum val- 
ue of a histogram of temporal differential of the im- 
age feature parameter values for said each sub-re- 
gion over the prescribed period of time t^. 

20. The method of claim 1 , wherein each of the input 
images entered at the step (a) is a color image in- 
cluding a plurality of color components, and the 
steps (b), (d), and (e) are executed for each of said 
plurality of color components of each input image 
separately. 

21 . An apparatus for moving object extraction based on 
background subtraction, comprising: 

input means for sequentially entering input 
images containing a moving object region to be ex- 
tracted; 

storage means for storing temporal changes 
of image feature parameter values for sub-regions 
subdividing a frame of each input image entered by 
the input means; 

background update means for statistically 
processing a temporal change of the image feature 
parameter values for each sub-region within a pre- 
scribed target region of the frame stored by the stor- 
age means over a prescribed period of time \$ to 
obtain at least one statistical quantity characterizing 
said temporal change, judging whether said tempo- 



ral change is due to an illumination change or not 
according to said statistical quantity and a pre- 
scribed illumination change judging condition, and 
updating a background image value for said each 
5 sub-region by a new background image value ac- 
cording to the image feature parameter values for 
said each sub-region during the prescribed period 
of time t0, so as to obtain a reconstructed back- 
ground image; 

10 subtraction means for applying a subtraction 

processing to one of the input images entered by 
the input means and the reconstructed background 
image obtained by the background update means 
to obtain a subtraction image; and 

is binarization means for applying a binarization 

processing to the subtraction image obtained by the 
subtraction means to extract the moving object re- 
gion from the input images entered by the input 
means. 

20 

22. The apparatus of claim 21 , wherein the background 
update means judges whether said temporal 
change is due to the illumination change or not by 
obtaining a histogram of the image feature Param- 

25 eter values for said each sub-region over the pre- 
scribed period of time t 0 , obtaining said statistical 
quantity from said histogram, and comparing said 
statistical quantity with a predetermined reference 
statistical quantity representing a case of the illumi- 

30 nation change. 

23. The apparatus of claim 21 , wherein the background 
update means uses the new background image val- 
ue which is either one of an extreme value and a 

35 mean value of the image feature parameter values 
for said each sub-region over the prescribed period 
of time t 0 . 

24. The apparatus of claim 21 , wherein said each sub- 
40 region is a pixel in the frame, and the background 

update means uses said prescribed target region 
which is a sift shaped region in the frame. 

25. The apparatus of claim 21 , wherein the background 
45 update means judges whether said temporal 

change is due to the illumination change or not by 
obtaining a histogram of the image feature param- 
eter values for said each sub-region over the pre- 
scribed period of time t 0 , obtaining said statistical 
50 quantity from said histogram, and relatively com- 
paring said statistical quantity for said each sub-re- 
gion with statistical quantities for other sub-regions 
in a vicinity of said each sub-region. 

55 26. The apparatus of claim 21, wherein the storage 
means stores the image feature parameter Values 
of n types of image feature parameters for said each 
sub-region with respect to the input images sequen- 
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tially entered by the input means, where n is an in- 
teger greater than one, and the background update 
means judges whether said temporal change is due 
to the illumination change or not by forming n-di- 
mensional feature vectors from the image feature s 
parameter values of said n types of the image fea- 
ture parameters for said each sub-region over the 
prescribed period of time tg, obtaining said statisti- 
cal quantity by statistically processing a set of said 
n-dimensional feature vectors, and judging whether io 
said statistical quantity satisfies the predetermined 
illumination change judging condition. 

27. The apparatus of claim 26, wherein the background 
update means judges whether said temporal is 
change is due to the illumination change or not by 
obtaining a histogram of distances between frames 

of each of said n-dimensional feature vectors over 
the prescribed period of time t©. obtaining said sta- 
tistical quantity from said histogram, and comparing 20 
said statistical quantity with a predetermined refer- 
ence statistical quantity representing a case of the 
illumination change. 

28. The apparatus of claim 26, wherein the background 2$ 
update means judges whether said temporal 
change is due to the illumination change or not by 
obtaining in advance a characteristic curve of said 
n-dimensional vectors for said each sub-region in- 
dicating a manner by which said n-dimensional vec- 30 
tors change in a case of the illumination change, 
obtaining a histogram of distances between said 
characteristic curve and said n-dimensional feature 
vectors, obtaining said statistical quantity from said 
histogram, and comparing said statistical quantity 35 
with a predetermined reference statistical quantity 
representing a case of the illumination change. 

29. The apparatus of claim 28, wherein the background 
update means obtains said statistical quantity *o 
which is at least one of a mean value of the distanc- 
es in said histogram and a variance of said histo- 
gram. 

30. The apparatus of claim 28, wherein the background 45 
update means also judges whether the illumination 
change is gradual or abrupt according to a motion 
vector of a point projecting each of said n-dimen- 
sional vectors for said each sub-region onto said 
characteristic curve. 5o 

31 . The apparatus of claim 21 , wherein the background 
update means uses the prescribed illumination 
change judging condition which includes a plurality 

of conditions for specifying a plurality of different 55 
manners to update the background image value for 
said each sub-region. 



32. The apparatus of claim 21 1 wherein the subtraction 
means applies the subtraction processing to a latest 
one of the input images entered by the input means 
and the reconstructed background image obtained 
by the background update means. 

33. The apparatus of claim 21 , wherein the subtraction 
means applies the subtraction processing to one of 
the input images entered at a prescribed period of 
time t 1 earlier than a current timing by the input 
means and the reconstructed background image 
obtained at the current timing by the background 
update means. 

34. The apparatus of claim 33, wherein the background 
update means uses the new background image val- 
ue which is a mean value of the image feature pa- 
rameter values for said each sub-region over a pre- 
scribed period of time ^ centered around a timing 
which is the prescribed period of time ^ earlier than 
the current timing. 

35. The apparatus of claim 21, further comprising set- 
ting means for setting a threshold used in the bina- 
rization processing by the binarization means to be 
different for different sub-regions. 

36. The apparatus of claim 35, wherein the setting 
means sequentially updates the threshold used in 
the binarization processing for said each sub-region 
according to a value obtained by statistically 
processing the temporal change of the image fea- 
ture parameter values for said each sub-region over 
the prescribed period of time tg. 

37. The apparatus of claim 21 , wherein the background 
update means also judges whether there is any 
change in the background image according to the 
temporal change of the image feature parameter 
values stored by the storage means, and omits an 
operation to update the background image value 
when it is judged that there is no change in the back- 
ground image. 

38. The apparatus of claim 21 , wherein the background 
update means uses said statistical quantity which 
is at least one of a variance and a distribution shape 
of a histogram of the image feature parameter val- 
ues for said each sub-region over the prescribed 
period of time t 0 . 

39. The apparatus of claim 38, wherein the background 
update means uses said statistical quantity which 
further includes a maximum value of a histogram of 
temporal differential of the image feature parameter 
values for said each sub-region over the prescribed 
period of time t 0 . 
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40. The apparatus of claim 21 , wherein each of the in- 
put images entered by the input means is a color 
image including a plurality of color components, and 
each of the storage means, the subtraction means, 
and the binarization means function for each of said 
plurality of color components of each input image 
separately. 



Patentanspruche 

1. Verfahren zum Herausziehen eines sich bewegen- 
den Objekts auf der Grundlage einer Subtraktion 
des Hintergrunds mit folgenden Schritten: 

(a) Aufeinanderfolgende Eingabe von Ein- 
gangsbildem, welche einen Bereich mit einem 
sich bewegenden Objekt enthalten, der her- 
ausgezogen werden soli; 

(b) Speichem zeitlicher Anderungen von Bild- 
merkmalsparameterwerten fOr Unterbereiche, 
welche einen Rahmen jedes EingangsbikJes 
unterteilen, das im Schritt (a) eingegeben wur- 
de; 

(c) statistische Bearbeitung einer zeitlichen An- 
derung der Bildmerkmalsparameterwerte fur 
jeden Unterbereich innerhalb eines vorbe- 
stimmten Zielbereichs des Rahmens, der in 
dem Schritt (b) gespeichert wurde, uber einen 
vorbestimmten Zeitraum to, um zumindest eine 
statistische GroBe zu erhalten, welche die zeit- 
liche Anderung charakterisiert, Beurteilung, ob 
die zeitliche Anderung infolge einer Beleuch- 
tungsanderung auftritt oder nicht, entspre- 
chend der statistischen GroBe, und einem vor- 
bestimmten Beleuchtungsanderungsbeurtei- 
lungszustand, und Aktualisierung eines Hinter- 
grundbildwertes fur jeden Unterbereich durch 
einen neuen Hintergrundbildwert entspre- 
chend den Bildmerkmalsparameterwerten fur 
den Unterbereich wahrend des vorbestimmten 
Zeitraums t^ um so ein rekonstruiertes Hinter- 
grundbild zu erreichen; 

(d) Einsatz einer Subtraktionsbearbeitung bei 
einem der Eingangsbilder, die im Schritt (a) ein- 
gegeben wurden, und dem rekonstruierten Hin- 
tergrundbild, welches im Schritt (c) erhalten 
wurde, um ein Subtraktionsbild zu erhalten; 
und 

(e) Einsatz einer Binarumwandlungsverarbei- 
tung bei dem Subtraktionsbild, welches im 
Schritt (d) erhalten wurde, um den Bereich mit 
dem sich bewegenden Objekt aus den Ein- 
gangsbilder n herauszuziehen, die im Schritt (a) 



eingegeben wurden. 

2. Verfahren nach Anspruch 1 , bei welchem im Schritt 
(c) beurteilt wird, ob die zeitliche Anderung infolge 

5 der Beleuchtungsanderung auftritt oder nicht, und 
zwar dadurch, daB ein Histogramm der Bildmerk- 
malsparameterwerte fur jeden Unterbereich Ober 
den vorbestimmten Zeitraum to erhalten wird, die 
statistische GroBe aus dem Histogramm erhalten 

10 wird, und die statistische GroBe mit einer vorbe- 
stimmten statistischen BezugsgroBe verglichen 
wird, welche einen Fall der Beleuchtungsanderung 
reprasentiert. 

15 3. Verfahren nach Anspruch 1 , bei welchem im Schritt 
(c) der neue Hintergrundbildwert entweder ein Ex- 
tremwert oder ein Mittelwert der Bildmerkmalspara- 
meterwerte f Or jeden Unterbereich uber den vorbe- 
stimmten Zeitraum to ist. 

20 

4. Verfahren nach Anspruch 1 , bei welchem in Schritt 
(c) jeder der Unterbereiche ein Pixel in dem Rah- 
men ist, und der vorbestimmte Zielbereich ein 
schlitzformiger Bereich in dem Rahmen ist. 

25 

5. Verfahren nach Anspruch 1 , bei welchem im Schritt 
(c) beurteilt wird, ob die zeitliche Anderung infolge 
der Beleuchtungsanderung auftritt oder nicht, und 
zwar dadurch, daB ein Histogramm der Bildmerk- 

30 malsparameterwerte fur jeden Unterbereich uber 
den vorbestimmten Zeitraum to erhalten wird, die 
statistische GroBe aus dem Histogramm erhalten 
wird, und ein relativer Vergleich der statistischen 
GroBe fur jeden Unterbereich mit statistischen Gro- 
ss Ben f urandere Unterbereiche in der Nahe jedes der 
Unterbereiche erfolgt. 

6. Verfahren nach Anspruch 1 , bei welchem im Schritt 

(b) die Bildmerkmalsparameterwerte von n Arten 
40 von Bildmerkmalsparametern fur die Unterbereiche 

in Bezug auf die Eingangsbilder gespeichert wer- 
den, die hintereinander im Schritt (a) eingegeben 
wurden, wobei n eine ganze Zahl groBer als 1 ist, 
und im Schritt (c) beurteilt wird, obdie zeitliche An- 

45 derung infolge der Beleuchtungsanderung auftritt 
oder nicht, und zwar durch Erzeugung n-dimensio- 
naler Merkmalsvektoren aus dem Bildmerkmalspa- 
rameterwerten fur die n Arten der Bildmerkmalspa- 
rameter fur jeden Unterbereich uber den vorbe- 

so stimmten Zeitraum to, die statische GroBe dadurch 
erhalten wird, daB statistisch eine Gruppe der n-di- 
mensionalen Merkmalsvektoren bearbeitet wird, 
und beurteilt wird, ob die statistische GroBe die vor- 
bestimmte Beleuchtungsanderungsbeurtei- 

55 lungsbedingung erfullt. 

7. Verfahren nach Anspruch 6, bei welchem im Schritt 

(c) beurteilt wird, ob die zeitliche Anderung infolge 
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der Beleuchtungsanderung auftritt oder nicht, und 
zwar dadurch, daB ein Histogramm von Entfernun- 
gen zwischen Rahmen jedes der n-dimensionalen 
Merkmalsvektoren uber den vorbestimmten Zeit- 
raum 1q erhalten wird, die statist ische GroBe aus 
dem Histogramm erhaften wird. und die statistische 
GroBe mit einer vorbestimmten statischen Bezugs- 
groBe verglichen wird, welche einen Fall der Be- 
leuchtungsanderung represent iert. 

8. Verfahren nach Anspruch 6, bei welchem im Schritt 
(c) beurteilt wird, ob die zeitiiche Anderung infolge 
der Beleuchtungsanderung auftritt oder nicht, und 
zwar dadurch, daB vorher eine Eigenschaftskurve 
der n-dimensionalen Vektoren fur jeden Unterbe- 
reich erhalten wird, welche eine Art und Weise an- 
zeigt, gemaB welcher sich die n-dimensionalen 
Vektoren in einem Fall der Beleuchtungsanderung 
andem, ein Histogramm von Entfernungen zwi- 
schen der Eigenschaftskurve und den n-dimensio- 
nalen Merkmalsvektoren erhalten wird, die stati- 
sche GroBe aus dem Histogramm erhalten wird, 
und die statische GroBe mit einer vorbestimmten 
statistischen BezugsgroBe verglichen wird, welche 
einen Fall der Beleuchtungsanderung reprasen- 
tiert. 

9. Verfahren nach Anspruch 8, bei welchem im Schritt 
(c) die statische GroBe zumindest entweder ein Mit- 
telwert der Entfernungen in dem Histogramm oder 
eine varianz des Histogramms ist 

10. Verfahren nach Anspruch 8, bei welchem der 
Schritt (c) ebenfalls beurteilt, ob die Beleuchtungs- 
anderung allmahlich oder abrupt erfolgt, entspre- 
chend einem Bewegungsvektor eines Punkts, der 
jeden der n-dimensionalen Vektoren fOr jeden Un- 
terbereich auf die Eigenschaftskurve projiziert. 

11 . Verfahren nach Anspruch 1 , bei welchem im Schritt 

(c) die vorbestimmte Beleuchtungsanderungsbeur- 
teilungsbedingung mehrere Bedingungen zur Fest- 
legung mehrerer Arten und Weisen zum Aktualisie- 
ren des Hintergrundbildwertes fur jeden Unterbe- 
reich enthalt 

12. Verfahren nach Anspruch 1, bei welchem im Schritt 

(d) die Subtraktionsverarbeitung bei einem jung- 
sten der Eingangsbilder eingesetzt wird, die in dem 
Schritt (a) eingegeben werden, und beim rekonstru- 
ierten Hintergrundbild, welches im Schritt (c) erhal- 
ten wird. 

1 3. Verfahren nach Anspruch 1 , bei welchem im Schritt 
(d) die Subtraktionsverarbeitung bei einem der Ein- 
gangsbilder eingesetzt wird, welches einen vorbe- 
stimmten Zeitraum t 1 fruher als ein momentaner 
Zeitpunkt durch den Schritt (a) eingegeben wurde, 



und beim rekonstruierten Hintergrundbild, welches 
zum momentanen Zeitpunkt durch den Schritt (c) 
erhalten wird. 

5 14. Verfahren nach Anspruch 13, bei welchem im 
Schritt (c) der neue Hintergrundbildwert ein Mittel- 
wert der Bildmerkmalsparameterwerte fur jeden 
Unterbereich uber einen vorbestimmten Zeitraum t2 
ist, der urn einen Zeitpunkt herum zentriert ist, wel- 

10 cher urn den vorbestimmten Zeitraum \, vor dem 
momentanen Zeitpunkt liegt. 

15. Verfahren nach Anspruch 1, bei welchem in dem 
Schritt (e) eine Schwelle, die bei der Binarumwand- 

i£ lungsverarbeitung verwendet wird, unterschiedlich 
fur unterschiedliche Unterbereiche eingestellt ist. 

16. Verfahren nach Anspruch 15, bei welchem im 
Schritt (e) die Schwelle, die bei der Binarumwand- 

20 lungsverarbeitung fur jeden Unterbereich verwen- 
det wird, aufeinanderfolgend entsprechend einem 
Wert aktualisiert wird, der durch statistische Verar- 
beitung der zeitlichen Anderung der Bildmerkmals- 
parameterwerte fur jeden Unterbereich uber den 
25 vorbestimmten Zeitraum to erhalten wird. 

17. Verfahren nach Anspruch 1, welches weiterhin die 
Schritte umfaBt, zu beurteilen, ob irgendeine Ande- 
rung in dem Hintergrundbild vorhanden ist, entspre- 

30 chend der zeitlichen Anderung der Bildmerkmals- 
parameterwerte, die im Schritt (b) gespeichert wur- 
den, und eine Operation zum Aktualisieren des Hin- 
tergrundbildwertes im Schritt (c) wegzulassen, 
wenn beurteilt wird, daB keine Anderung in dem 
35 Hintergrundbild auftritt. 

18. Verfahren nach Anspruch 1, bei welchem im Schritt 
(c) die statistische GroBe zumindest entweder eine 
Varianz oder eine Verteilungsform eines Histo- 

40 gramms der Bildmerkmalsparameterwerte fOr je- 
den Unterbereich uber den vorbestimmten Zeit- 
raum to ist 

19. Verfahren nach Anspruch 18, bei welchem im 
45 Schritt (c) die statische GroBe weiterhin einen Ma- 

ximalwert eines Histogramms der zeitlichen Ablei- 
tung der Bildmerkmalsparameterwerte fur jeden 
Unterbereich uber den vorbestimmten Zeitraum ^ 
enthalt. 

50 

20. Verfahren nach Anspruch 1 , bei welchem jedes der 
Eingangsbilder, die im Schritt (a) eingegeben wer- 
den, ein Farbbild ist, welches mehrere Farbkompo- 
nenten enthalt, und die Schritte (b), (d) und (e) fur 

55 jede der mehreren Farbkomponenten jedes Ein- 
gangsbilds getrennt durchgef uhrt werden. 

21. Einrichtung zum Herausziehen eines sich bewe- 
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genden Objekts auf der Grundlage einer Subtrakti- 
on des Hintergrunds, welche aufweist: 

eine Eingabevorrichtung zum aufeinanderfol- 
genden Eingeben von Eingangsbildem, welche s 
einen Bereich mit einem sich bewegenden Ob- 
jekt enthalten, welcher herausgezogen werden 
soil; 

eine Speichervorrlchtung zum Spelchern zeitli- 10 
cher Anderungen, von Bildmerkmalsparame- 
terwerten fur Unterbereiche, welche einen 
Rahmen jedes Eingangsbildes unterteilen, das 
durch die Eingabevorrichtung eingegeben wur- 
de; »« 

eine Hintergrundaktualisierungsvorrichtung 
zur statistischen Verarbeitung einer zeitlichen 
Anderung der Bildmerkmalsparameterwerte 
fur jeden Unterbereich innerhalb eines vorbe- 20 
stimmten Zielbereiches des Rahmens, der 
durch die Speichervorrichtung gespeichert 
wurde, uber einen vorbestimmten Zeitraum \q, 
um zumindest eine statistische GroBe zu erhal- 
ten, welche die zeitliche Anderung charakteri- 2$ 
siert, zu beurteilen, ob die zeitliche Anderung 
infolge einer Beleuchtungsanderung auftritt 
Oder nicht, entsprechend der statistischen Gro- 
Be und einer vorbestimmten Beleuchtungsan- 
derungsbeurteilungsbedingung, und einen 30 
Hintergrundbildwert fur jeden Unterbereich 
durch einen neuen Hintergrundbildwert ent- 
sprechend den Bildmerkmalsparameterwerten 
fur jeden Unterbereich wan rend des vorbe- 
stimmten Zeitraums t 0 zu aktualisieren, um so 35 
ein rekonstruiertes Hintergrundbild zu erhalten; 

eine Subtraktionsvorrichtung zum Einsatz ei- 
ner Subtraktionsverarbeitung bei einem der 
Eingangsbilder, die durch die Eingabevorrich- 40 
tung eingegeben wurden, und dem rekonstru- 
ierten Hintergrundbild, welches durch die 
Hintergrundaktualisierungsvorrichtung erhal- 
ten wurde, um ein Subtraktionsbild zu erhalten; 
und 45 

eine Binarumwandlungsvorrichtung zum Ein- 
satz einer Binarumwandlungsverarbeitung bei 
dem Subtraktionsbild, welches von der Sub- 
traktionsvorrichtung erhalten wurde, um den so 
Bereich mit einem sich bewegenden Objekt 
aus den Eingangsbildem herauszuziehen, die 
von der Eingabevorrichtung eingegeben wur- 
den. 

55 

22. Einrichtung nach Anspruch 21 , bei welcher die Hin- 
tergrundaktualisierungsvorrichtung beurteitt, ob die 
zeitliche Anderung infolge der Beleuchtungsande- 



rung auftritt oder nicht, und zwar dadurch, daB ein 
Histogramm der Bildmerkmalsparameterwerte fur 
jeden Unterbereich uber den vorbestimmten Zeit- 
raum t 0 erhalten wird, die statistische GroBe aus 
dem Histogramm erhalten wird, und die statistische 
GroBe mit einer vorbestimmten statistischen Be- 
zugsgroBe verglichen wird, welche einen Fall der 
Beleuchtungsanderung rep rase ntiert. 

23. Einrichtung nach Anspruch 21, bei welcher die 
Hintergrundaktualisierungsvorrichtung den neuen 
Hintergrundbildwert verwendet, der entweder ein 
Extremwert Oder ein Mittelwert der Bildmerkmals- 
parameterwerte fOr jeden Unterbereich uber den 
vorbestimmten Zeitraum \q ist. 

24. Einrichtung nach Anspruch 21, bei welcher jeder 
Unterbereich ein Pixel in dem Rahmen ist, und die 
Hintergrundaktualisierungsrichtung den vorbe- 
stimmten Zielbereich verwendet, der ein schlitzfor- 
miger Bereich in dem Rahmen ist. 

25. Einrichtung nach Anspruch 21, bei welcher die 
Hintergrundaktualisierungsvorrichtung beurteilt, ob 
die zeitliche Anderung infolge der Beleuchtungsan- 
derung auftritt oder nicht, und zwar dadurch, daB 
ein Histogramm der Bildmerkmalsparameterwerte 
fur jeden Unterbereich uber den vorbestimmten 
Zeitraum Xq erhalten wird, die statische GroBe aus 
dem Histogramm erhalten wird, und ein Relatiwer- 
gleich der statistischen GroBe fur jeden Unterbe- 
reich mit statistischen GroBen fur andere Unterbe- 
reiche in den Nahe jedes der Unterbereiche erfolgt. 

26. Einrichtung nach Anspruch 21, bei welcher die 
Speichervorrichtung die Bildmerkmalsparameter- 
werte von n Arten von Bildmerkmalsparametern fur 
jeden Unterbereich in Bezug auf die Eingangsbilder 
speichert, die hintereinander durch die Eingabevor- 
richtung eingegeben werden, wobei n eine groBe 
Zahl groBer als 1 ist, und die Hintergrundaktualisie- 
rungsvorrichtung beurteilt, ob die zeitliche Ande- 
rung infolge der Beleuchtungsanderung auftritt 
oder nicht, und zwar dadurch, daB n-dimensionale 
Merkmalsvektoren aus den Bildmerkmalsparame- 
terwerten der n Arten der Bildmerkmalsparameter 
fur jeden Unterbereich uber den vorbestimmten 
Zeitraum Xq erzeugt werden, die statistische GroBe 
durch statische Verarbeitung einer Gruppe der n- 
dimensionalen Merkmalsvektoren erhalten wird, 
und beurteilt wird, ob die statistische GroBe die vor- 
bestimmte Beleuchtungsanderungsbeurtei- 
lungsbedingung erfullt. 

27. Einrichtung nach Anspruch 26, bei welcher die 
Hintergrundaktuaiisierungsvorrichtung beurteilt, ob 
die zeitliche Anderung infolge der Beleuchtungsan- 
derung auftritt oder nicht, und zwar dadurch, daB 
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ein Histogramm von Entfernungen zwischen Rah- 
men jedes der n-dimensionalen Merkmalsvektoren 
uber den vorbestimmten Zeitraum Xq emalten wird, 
die statistische GrdBe aus dem Histogramm emal- 
ten wird, und die statistische GroBe mit einer vor- 
bestimmten statistischen BezugsgroBe verglichen 
wird, welche einen Fall der Beleuchtungsanderung 
reprasentiert 

28. Einrichtung nach Anspruch 26, bei welcher die 
Hintergrundaktualisierungsvorrichtung beurteilt, ob 
die zeitliche Anderung infoige der Beleuchtungsan- 
derung auftritt oder nicht, und zwar dadurch, daB 
vomer eine Eigenschaftskurve der n-dimensiona- 
len Vektoren fur jeden Unterbereich emalten wird, 
welche die Art und Weise angibt, in welcher sich die 
n-dimensionalen Vektoren im Falle der Beleuch- 
tungsanderung andern, ein Histogramm von Entfer- 
nungen zwischen der Eigenschaftskurve und den 
n-dimensionalen Merkmalsvektoren erhatten wird, 
die statistische GrdBe aus dem Histogramm emal- 
ten wird, und die statistische GrdBe mit einer vor- 
bestimmten statistischen BezugsgroBe verglichen 
wird, welche einen Fall der Beleuchtungsanderung 
reprasentiert. 

29. Einrichtung nach Anspruch 28, bei welcher die 
Hintergrundaktualisierungsvorrichtung die statisti- 
sche GroBe erhalt, die zumindest entweder ein Mit- 
telwert der Entfernungen in dem Histogramm oder 
eine Varianz des Histogramms ist. 

30. Einrichtung nach Anspruch 28, bei welcher die 
Hintergrundaklualisierungsvorrichtung auch beur- 
teilt, ob die Beleuchtungsanderung allmahlich oder 
abrupt erfolgt, entsprechend einem Bewegungs- 
vektor eines Punkts, welcher jeden der n-dimensio- 
nalen Vektoren fur jeden Unterbereich auf die Ei- 
genschaftskurve projiziert 

31. Einrichtung nach Anspruch 21, bei welcher die 
Hintergrundaktualisierungsvorrichtung die vorbe- 
stimmte Beleuchtungsanderungsbeurtei- 
lungsbedingung verwendet, welche mehrere Be- 
dingungen zur Festlegung mehrerer unterschiedli- 
cher Arten und Weisen zum Aktualisieren des Hin- 
tergrundbiidwertes fur jeden Unterbereich enthalt. 

32. Einrichtung nach Anspruch 21 , bei welcher die Sub- 
traktionsvorrichtung die Subtraktionsverarbeitung 
bei einem jungsten der Eingangsbilder einsetzt, die 
von der Eingabevorrichtung eingegeben werden, 
und beim rekonstruierten Hintergrundbild, welches 
von der Hintergrundaktualisierungsvorrichtung er- 
halten wird. 

33. Einrichtung nach Anspruch 21 , bei welcher die Sub- 
traktionsvorrichtung die Subtraktionsverarbeitung 



bei einem der Eingangsbilder einsetzt, welches ei- 
nen vorbestimmten Zeitraum t t fruher als ein mo- 
mentaner Zeitpunkt von der Eingabevorrichtung 
eingegeben wird, und bei dem rekonstruierten Hin- 
s tergrundbild, welches zum momentanen Zeitpunkt 
von der Hintergrundaktualisierungsvorrichtung er- 
halten wird. 

34. Einrichtung nach Anspruch 33, bei welcher die 
10 Hintergrundaktualisierungsvorrichtung den neuen 

Hintergrundbildwert verwendet, der ein Mittelwert 
der Bildmerkmalsparameterwerte fur jeden Unter- 
bereich uber einen vorbestimmten Zeitraum t 2 ist, 
der urn einen Zeitpunkt herum zentriert ist, der urn 
15 den vorbestimmten Zeitraum t 1 vor dem momenta- 
nen Zeitpunkt liegt. 

35. Einrichtung nach Anspruch 21 , welche weiterhin ei- 
ne Einstellvorrichtung zur Einstellung einer Schwel- 

20 |e auf wetst, die bei der Binarumwandlungsverarbei- 
tungdurch die Binarumwandlungsverarbeitung ver- 
wendet wird, und zwar unterschiedlich fur unter- 
schiedliche Unterbereiche. 

2S 36. Einrichtung nach Anspruch 35, bei welcher die Ein- 
stellvorrichtung nacheinander die Schwelle aktuali- 
siert, die bei der Binarumwandlungsverarbeitung 
fur jeden Unterbereich verwendet wird, entspre- 
chend einem Wert, der durch statistische Verarbei- 

so tung der zeitlichen Anderung der Bildmerkmalspa- 
rameterwerte fur jeden Unterbereich uber den vor- 
bestimmten Zeitraum t 0 emalten wird. 

37. Einrichtung nach Anspruch 21, bei welcher die 
35 Hintergrundaktualisierungsvorrichtung beurteilt, ob 

irgendeine Anderung des Hintergrundbildes auftritt, 
entsprechend der zeitlichen Anderung der Biimerk- 
malsparameterwerte, die durch die Speichervor- 
richtung gespeichert werden, und eine Operation 
40 zum Aktualisieren des Hintergrundbildwertes weg- 
laBt, wenn beurteilt wird, daB keine Anderung in 
dem Hintergrundbild auftritt. 

38. Einrichtung nach Anspruch 21, bei welcher die 
45 Hintergrundaktualisierungsvorrichtung die statisti- 
sche GroBe verwendet, die zumindest entweder ei- 
ne \farianz oder eine Verteilungsform eines Histo- 
gramms der Bildmerkmalsparameterwerte fur je- 
den Unterbereich Ober den vorbestimmten Zeit- 

so raum \q ist. 

39. Einrichtung nach Anspruch 38, bei welcher die 
Hintergrundaktualisierungsvorrichtung die statisti- 
sche GroBe verwendet, die weiterhin einen Maxi- 

55 malwert eines Histogramms der zeitlichen Ablei- 
tung der Bildmerkmalsparameterwerte fur jeden 
Unterbereich Ober den vorbestimmten Zeitraum to 
enthalt. 
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40. Einrichtung nach Anspruch 21, bei welcher jedes 
der Eingangsbilder, die von der Eingabevorrichtung 
eingegeben werden, ein Farbbild ist, welches meh- 
rere Farbkomponenten enthaft, und sowohl die 
Speichervorrichtung, a!s auch die Subtraktionsvor- 
richtung und die Binarumwandlungsvorrichtung fur 
jede der mehreren Farbkomponenten jedes Ein- 
gangsbildes getrennt arbeiten. 



Revendlcatfons 

1. Precede d'extraction d'un objet mobile fondee sur 
une soustraction d'arriere-plan, comprenant les 
stapes consistant a : 

(a) recevoir sequentiellement en entr6e des 
images contenant une region d'un objet mobile 
devant etre extraite, 

(b) m6moriser des variations dans te temps des 
valeurs des parametres de caracteristiques 
d'image pour des sous-regions subdivisant une 
trame de chaque image d'entree, recue en en- 
tree a Tetape (a), 

(c) traiter de facpn statistique une variation 
dans le temps des valeurs des parametres de 
caracteristiques d'image pour chaque sous-re- 
gion a Tinterieur d'une region cible prescrite de 
la trame memorised a l'6tape (b) sur un inter- 
valle de temps present to afin d'obtenir au 
moins une quantity statistique caracterisant la- 
dite variation dans le temps, evaluer si lad it e 
variation dans le temps est due a une variation 
d'illumination ou non conform6ment a ladite 
quantity statistique et a une condition devalua- 
tion de variation d'illumination prescrite, et met- 
tre a jour une valeurd'image d'arridre-plan pour 
ladite sous-region grace a une nouvelle valeur 
d'image cTarriere-plan, conformement aux va- 
leurs des parametres de caracteristiques 
d'image pour ladite chaque sous-region durant 
Tintervaile de temps present to, de facpn a ob- 
tenir une image d'arriere-plan reconstitute, 

(d) appliquer un traitement de soustraction a 
Tune des images d'entree, recues en entree a 
Tetape (a) et a I'image d'arriere-plan reconsti- 
tute obtenue a I'etape (c) afin d'obtenir une 
image de soustraction, et 

(e) appliquer un traitement de conversion en bi- 
naire a I'image de soustraction obtenue a l'6ta- 
pe (d) afin d'extraire la region de I'objet mobile 
des images d'entree. recues en entr6e a T6tape 
(a). 

2. Precede* selon la revendication 1, dans lequel a 
Tetape (c), le fait que ladite variation dans le temps 
est due a la variation d'illumination ou non, est lva- 
lue en obtenant un histogramme des valeurs des 



parametres de caracteristiques d'image pour ladite 
chaque sous-region sur Tintervaile de temps pres- 
ent t 0 , en obtenant ladite quantity statistique a partir 
dudit histogramme, et en comparant ladite quantite 
s statistique a une quantity statistique de reference 
prtdtterminee repr6sentant un cas de variation d'il- 
lumination. 

3. Precede selon la revendication 1, dans lequel a 
10 Tetape (c), la nouvelle valeur d'image d'arriere-plan 

est Tune ou I'autre d'une valeur extreme et d'une 
valeur moyenne des valeurs des parametres de ca- 
racteristiques d'image pour chaque sous-region sur 
Tintervaile de temps present to. 

15 

4. Precede selon la revendication 1, dans lequel a 
T6tape (c), ladite chaque sous-r6gion est un pixel 
de la trame, et ladite region cible prescrite est une 
region en forme de fente dans la trame. 

20 

5. Precede selon la revendication 1, dans lequel a 
Tetape (c), le fait que ladite variation dans le temps 
soit due a la variation d'illumination ou non, est 6va- 
lue en obtenant un histogramme des valeurs des 

2S parametres de caracteristiques d'image pour cha- 
que dite sous-region sur Tintervaile de temps pres- 
crit Xq, en obtenant ladite quantite statistique a partir 
dudit histogramme, et en comparant relativement 
ladite quantite statistique pour ladite chaque sous- 

30 region a des quantites statistiques pour d'autres 
sous-r6gions au voisinage de ladite chaque sous- 
region. 

6. Precede selon la revendication 1, dans lequel a 
35 Tetape (b), les valeurs des parametres de caracte- 
ristiques d'image de n types de parametres de ca- 
racteristiques d'image pour les sous-regions sont 
memorisees en fonction des images d'entree re- 
cues sequentiellement en entree a Tetape (a), dans 

40 lequel n est un nombre entier superieur a un, et a 
Tetape (c), le fait que ladite variation dans le temps 
soit due a une variation d'illumination ou non est 
evalue en constituant des vecteurs de caracteristi- 
ques a n dimensions a partir des valeurs des para- 

45 metres de caracteristiques d'image desdits n types 
des parametres de caracteristiques d'image pour 
ladite chaque sous-region sur Tintervaile de temps 
present t 0 , en obtenant ladite quantite statistique 
par un traitement statistique d'un ensemble desdits 

50 vecteurs de caracteristiques a n dimensions, et en 
evaluant si ladite quantite statistique satisfait la con- 
dition devaluation de variation d'illumination precte- 
terminee. 

55 7. Precede selon la revendication 6, dans lequel a 
Tetape (c), le fait que ladite variation dans le temps 
soit due a la variation d'illumination ou non, est eva- 
lue en obtenant un histogramme des distances en- 
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tre des trames de chacun desdits vecteurs de ca- 
racteristiques a n dimensions sur I'intervalle de 
temps prescrit \q, en obtenant ladite quantity statis- 
tique a partir dudit histogramme, et en comparant 
ladite quantite statistique a une quantity statistique 
de reference predeterminee representant un cas de 
variation d'illumination. 

8. Procede selon la revendication 6, dans lequei a 
I'etape (c), le fait que ladite variation dans le temps 
soitdue a la variation d'illumination ou non, est 6va- 
lue* en obtenant a I'avance une courbe de caracte- 
ristiques desdits vecteurs a n dimensions pour la- 
dite chaque sous-region indiquant une maniere se- 
lon laquelle lesdits vecteurs a n dimensions varient 
dans le cas d'une variation d'illumination, en obte- 
nant un histogramme des distances entre ladite 
courbe de caracteristiques et lesdits vecteurs de 
caracteristiques a n dimensions, en obtenant ladite 
quantite" statistique a partir dudit histogramme, et 
en comparant ladite quantite* statistique a une quan- 
tite statistique de reference predeterminee repre- 
sentant un cas de variation d'illumination. 

9. Procede selon la revendication 8, dans lequei a 
I'etape (c), ladite quantity statistique est au moins 
Tune d'une valeur moyenne des distances dans le- 
dit histogramme et d'une variance dudit histogram- 
me. 

10. Precede* selon la revendication 8, dans lequei l'6ta- 
pe (c) evalue egalement si la variation d'illumination 
est progressive ou brutate conformement a un vec- 
teur de mouvement d'un point de projection de cha- 
cun desdits vecteurs a n dimensions pour ladite 
chaque sous-region sur ladite courbe de caracteris- 
tiques. 

11. Proc6d6 selon la revendication 1, dans lequei a 
I'etape (c), la condition devaluation de variation d'il- 
lumination prescrite comprend une plurality de con- 
ditions destinies a specifier une pluralite de mante- 
res differentes afin de mettre a jour la valeur d'ima- 
ge d'arriere-plan pour ladite chaque sous-region. 

12. Proc6d6 selon la revendication 1, dans lequei a 
I'etape (d), le traitement de soustraction est appli- 
que a la plus recente des images d'entr6e revues 
en entree a I'etape (a) et de Pimage d'arriere-plan 
reconstitute obtenue a I'etape (c). 

13. Precede" selon la revendication 1, dans lequei a 
I'etape (d), le traitement de soustraction est appli- 
que a I'une des images d'entree recues en entree 
a un intervalle de temps prescrit t-, anterieur a un 
instant actuel par I'etape (a) et a I'image d'arriere- 
plan reconstitute obtenue a I'instant actuel par 
I'etape (c). 



14. Procdde selon la revendication 13, dans lequei a 
I'etape (c), la nouvelle valeur d'image d'arriere-plan 
est une valeur moyenne des valeurs des parame- 
tres de caracteristiques d'image pour ladite chaque 

£ sous-region sur un intervalle de temps prescrit ^ 
centre autour d'un instant qui est anterieur de I'in- 
tervalle de temps t-j prescrit a I'instant actuel. 

15. Precede" selon (a revendication 1, dans lequei a 
10 I'etape (e), un seuil utilise dans le traitement de con- 
version en binaire est etabli de facon a etre different 
pour differentes sous-regions. 

16. Procede selon la revendication 15, dans lequei a 
is I'etape (e), le seuil utilise" dans le traitement de con- 
version en binaire pour ladite chaque sous-region 
est mis a jour sequentiellement conformement a 
une valeur obtenue par un traitement statistique de 
la variation dans le temps des valeurs des parame- 

20 tres de caracteristiques d'image pour ladite chaque 
sous-region sur I'intervalle de temps prescrit t^ 

17. Procede selon la revendication 1, comprenant en 
outre les etapes consistant a evaluer s'il existe une 

2S variation quelconque de I'image d'arriere-plan con- 
formement a la variation dans le temps des valeurs 
des parametres de caracteristiques d'image memo- 
rises a I'etape (b), et a omettre une operation de 
mise a jour de la valeur d'image d'arriere-plan a 

30 l'6tape (c) torsqu'il est evalue" qu'il n*y a pas de va- 
riation de I'image d'arriere-plan. 

18. Procede selon la revendication 1, dans lequei a 
I'etape (c), ladite quantite statistique est au moins 

35 Pune d'une variance et d'une forme de distribution 
d'un histogramme des valeurs des parametres de 
caracteristiques d'image pour ladite chaque sous- 
region sur I'intervalle de temps prescrit tQ. 

40 19. Procede selon la revendication 18, dans lequei a 
I'etape (c), ladite quantite statistique comprend en 
outre une valeur maximum d'un histogramme d'une 
difference lie par rapport au temps des valeurs des 
parametres de caracteristiques d'image pour ladite 
45 chaque sous-region sur I'intervalle de temps pres- 
crit t(). 

20. Procede selon la revendicatbn 1 , dans lequei cha- 
cune des images d'entree recues en entree a I'eta- 

50 pe (a) est une image en couleur comprenant une 
pluralite de composantes de couleur, et les etapes 
(b), (d) et (e) sont executtes pour chaque compo- 
sante de ladite pluralite de composantes de couleur 
de chaque image d'entree, separement 

55 

21. Dispositif destine a une extraction d'objet mobile 
fondee sur une soustraction d'arriere-plan, 
comprenant : 



40 19. 



45 

20. 

50 
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un moyen d'entree destine a recevoir s6quen- 
tiellement en entree des images contenant une 
region d'un objet mobile devant etre extraite, 
un moyen de memorisation destine a memori- 
ser des variations dans le temps des valeurs 
des parametres de caracteristiques d'image 
pour des sous-regions subdivisant une trame 
de chaque image d'entree recue en entree gra- 
ce au moyen d'entree, 

un moyen de mise a jour de I'arriere-plan des- 
tine a traitor de facon statistique une variation 
dans le temps des valeurs des parametres de 
caracteristiques d'image pour chaque sous-re- 
gion a I'interieur d'une region cible prescrite de 
la trame memorised par le moyen de memori- 
sation sur un intervalle de temps present \q afin 
d'obtenir au moins une quantite statistique ca- 
racterisant ladite variation dans le temps, eva- 
luer si ladite variation dans le temps est due a 
une variation d' illumination ou non conformS- 
ment a ladite quantity statistique et a une con- 
dition devaluation de variation d'illumination 
prescrite, et mettre a jour une valeur d'image 
d'arriere-plan pour ladite chaque sous-region 
grace a une nouvelle valeur d'image d'arriere- 
plan conform ement aux valeurs des parame- 
tres de caracteristiques d'image pour ladite 
chaque sous-region durant I' intervalle de 
temps prescrit to, de facon a obtenir une image 
d'arriere-plan reconstitute, 
un moyen de soustraction destine a appliquer 
un traitement de soustraction a I'une des ima- 
ges d'entree recues en entree par le moyen 
d'entree et a I'image d'arriere-plan reconstitute 
obtenue par le moyen de mise a jour de I'arrie- 
re-plan afin d'obtenir une image de soustrac- 
tion, et 

un moyen de conversion en binaire destine a 
appliquer un traitement de conversion en binai- 
re a I'image de soustraction obtenue par le 
moyen de soustraction afin d'extraire la region 
de I'objet mobile des images d'entree recues en 
entr6e par le moyen d'entree. 

22. Dispositif selon la revendication 21 , dans lequet le 
moyen de mise a jour de I'arriere-plan evalue si la- 
dite variation dans le temps est due a la variation 
d'illumination ou non, en obtenant un histogramme 
des valeurs des parametres de caracteristiques 
d'image pour ladite chaque sous-region sur inter- 
val le de temps prescrit t 0 , en obtenant ladite quan- 
tity statistique a partir dudit histogramme, et en 
comparant ladite quantity statistique a une quantite 
statistique de reference predtterminee represen- 
tant un cas de variation d'illumination. 

23. Dispositif selon la revendication 21, dans lequel le 
moyen de mise a jour de I'arriere-plan utilise la nou- 



velle valeur d'image d'arriere-plan qui est I'une ou 
I'autre d'une valeur extreme et d'une valeur moyen- 
ne des valeurs des parametres de caracteristiques 
d'image pour ladite chaque sous-region sur I'inter- 
s vaile de temps prescrit t^ 

24. Dispositif selon la revendication 21 , dans lequel la- 
dite chaque sous-region est un pixel dans la trame, 
et le moyen de mise a jour de I'arriere-plan utilise 

10 ladite region cible prescrite qui est une region en 
forme de fente dans la trame. 

25. Dispositif selon la revendication 21 , dans lequel le 
moyen de mise a jour de I'arriere-plan 6value si la- 

15 dite variation dans le temps est due a la variation 
d'illumination ou non, en obtenant un histogramme 
des valeurs des parametres de caracteristiques 
d'image pour ladite chaque sous-region sur I'inter- 
valle de temps prescrit to, en obtenant ladite quan- 
go tite statistique a partir dudit histogramme, et en 
comparant relativement ladite quantite statistique 
pour ladite chaque sous-region a des quantites sta- 
tistiques pour d'autres sous-regions au voisinage 
de ladite chaque sous-region. 

25 

26. Dispositif selon la revendication 21 , dans lequel le 
moyen de memorisation memorise les valeurs des 
parametres des caracteristiques d'image de n types 
de parametres de caracteristiques d'image pour la- 

30 dite chaque sous-region en fonction des images 
d'entree recues sequentiellement en entree par le 
moyen d'entree, dans lequel n est un nombre entier 
supeneur a un, et le moyen de mise a jour de I'ar- 
riere-plan evalue si ladite variation dans le temps 

35 est due a la variation d'illumination ou non, en cons- 
tituant des vecteurs de caracteristiques a n dimen- 
sions a partir des valeurs des parametres de carac- 
teristiques d'image desdits n types des parametres 
de caracttristiques d'image pour ladite chaque 

^o sous-region sur I'intervalle de temps prescrit to, en 
obtenant ladite quantitt statistique par un traite- 
ment statistique d'un ensemble desdits vecteurs de 
caracteristiques a n dimensions, et en evaluant si 
ladite quantite statistique satisfait la condition 

45 devaluation des variations d'illumination prtdeter- 
min6e. 

27. Dispositif selon la revendication 26, dans lequel le 
moyen de mise a jour de I'arriere-plan evalue si la- 

50 dite variation dans le temps est due a la variation 
d'illumination ou non en obtenant un histogramme 
des distances entre des frames de chacun desdits 
vecteurs de caracteristiques a n dimensions sur Tin* 
tervalle de temps prescrit to, en obtenant ladite 

55 quantite statistique a partir dudit histogramme, et 
en comparant ladite quantite statistique a une quan- 
tite statistique de reference prtdeterminee repte- 
sentant un cas de variation d'illumination. 
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28. Dispositif selon la revendication 26, dans leque! le 
moyen de mise a jour de I'arriere-plan lvalue si la- 
dite variation dans le temps est due a la variation 
d'illumination ou non en obtenant a I'avance une 
courbe de caracteristiques desdits vecteurs a n di- 
mensions pour ladite chaque sous-region indiquant 
une maniere selon laquelle lesdits vecteurs a n di- 
mensions varient dans le cas d'une variation d'illu- 
mination, en obtenant un histogramme des distan- 
ces entre ladite courbe de caracteristiques et lesdits 
vecteurs de caracteristiques a n dimensions, en ob- 
tenant ladite quantite statistique a partir dudit histo- 
gramme, et en comparant ladite quantite statistique 
a une quantite statistique de reference predetermi- 
ned representant un cas de variation d'illumination. 

29. Dispositif selon la revendication 28, dans lequel le 
moyen de mise a jour de I'arriere-plan obtient ladite 
quantite statistique qui est au moins Tune d'une va- 
lour moyenne de distance dans led it histogramme 
et d'une variance dudit histogramme. 

30. Dispositif selon la revendication 28, dans lequel le 
moyen de mise a jour de I'arriere-plan evalue ega- 
lement si la variation d'illumination est progressive 
ou brutale confomrtement a un vecteur de mouve- 
ment d'un point de projection de chacun desdits 
vecteurs a n dimensions pour ladite chaque sous- 
region sur ladite courbe de caracteristiques. 

31. Dispositif selon la revendication 21, dans lequel le 
moyen de mise a jour de I'arriere-plan utilise la con- 
dition devaluation de variation d'illumination pres- 
erve qui comprend une plurality de conditions des- 
tinies a specifier une plurality de manieres differen- 
tes afin de mettre a jour la valeur d'image d'arriere- 
plan pour ladite chaque sous-region. 



50 

gbn sur un intervalle de temps prescrit t 2 centte 
autour d'un instant qui est anterieur de Pintervalle 
de temps prescrit t t a I'instant actuet. 

s 35. Dispositif selon la revendication 21 , comprenant en 
outre un moyen de reglage destine a regler un seuil 
utilise dans le traitement de conversion en binaire 
par le moyen de conversion en binaire de facon a 
elre different pour des sous-regions differentes. 

10 

36. Dispositif selon la revendication 35, dans lequel le 
moyen de reglage met a jour sequentiellement le 
seuil utilise dans le traitement de conversion en bi- 
naire pour ladite chaque sous-region conforrrte- 

is ment a une valeur obtenue par un traitement statis- 
tique de la variation dans le temps des valours des 
parametres de caracteristiques d'image pour ladite 
chaque sous-region sur Pintervalle de temps pres- 
ent t 0 . 

20 

37. Dispositif selon la revendication 21 , dans lequel le 
moyen de mise a jour de I'arriere-plan evalue 6ga- 
lement s'il existe une variation quelconque de ('ima- 
ge d'arriere-plan conformement a la variation dans 

2S |e temps des valeurs des parametres de caracteris- 
tiques d'image memoris6es par le moyen de memo- 
risation, et omet une operation de mise a jour de la 
valeur d'image d'arriere-plan lorsqu'il est evalue 
qu'il n"y a pas de variation de I'image d'arriere-plan. 

30 

38. Dispositif selon la revendication 21, dans lequel le 
moyen de mise a jour de I'arriere-plan utilise ladite 
quantite statistique qui est au moins I'une d'une va- 
riance et d'une forme de distribution d'un histogram- 

35 me des valeurs des parametres de caracteristiques 
d'image pour ladite chaque sous-region sur I'inter- 
valle de temps prescrit to. 



EP 0 671 706 B1 



32. Dispositif selon la revendication 21 , dans lequel le 
moyen de soustraction applique le traitement de 
soustraction a la plus recente des images d'entree 
recues en entree par le moyen d'entree et a I'image 
d'arriere-plan reconstitute obtenue par le moyen de 
mise a jour de I'arriere-plan. 

33. Dispositif selon la revendication 21, dans lequel le 
moyen de soustraction applique le traitement de 
soustraction a Pune des images d'entree recues en 
entree a un intervalle de temps prescrit \ A anterieur 
a un instant actuel par le moyen d'entree et a I'ima- 
ge d'arriere-plan reconstitute obtenue a I'instant 
actuel par le moyen de mise a jour de I'arriere-plan. 

34. Dispositif selon la revendication 33, dans lequel le 
moyen de mise a jour de I'arriere-plan utilise la nou- 
velle valeur d'image d'arriere-plan qui est une va- 
leur moyenne des valeurs des parametres de ca- 
racteristiques d'image pour ladite chaque sous-re- 



39. Dispositif selon la revendication 38, dans lequel le 
40 moyen de mise a jour de I'arriere-plan utilise ladite 

quantite statistique qui comprend en outre une va- 
leur maximum d'un histogramme d'une difterentielle 
par rapport au temps des valeurs des parametres 
de caracteristiques d'image pour ladite chaque 
45 sous-region sur Pintervalle de temps prescrit \q. 

40. Dispositif selon la revendication 21, dans lequel 
chacune des images d'entree recues en entree par 
le moyen d'entree est une image en couleur com- 

so prenant une pluralite de composantes de couleur, 
et chacun du moyen de memorisation, du moyen 
de soustraction, et du moyen de conversion en bi- 
naire fonctionne pour chaque composante de ladite 
pluralite de composantes de couleur de chaque 

55 image d'entree, separement. 
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